Feb 28 04:36:22 devstack cinder-volume[74426]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=74426) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Feb 28 04:36:22 devstack cinder-volume[74426]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=74426) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Feb 28 04:36:22 devstack cinder-volume[74426]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=74426) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Feb 28 04:36:23 devstack cinder-volume[74426]: INFO dbcounter [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] Registered counter for database cinder
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_db.sqlalchemy.engines [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74426) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG dbcounter [-] [74426] Writer thread running {{(pid=74426) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Feb 28 04:36:23 devstack cinder-volume[74426]: INFO cinder.rpc [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Feb 28 04:36:23 devstack cinder-volume[74426]: INFO cinder.rpc [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_db.sqlalchemy.engines [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74426) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 28 04:36:23 devstack cinder-volume[74426]: INFO cinder.volume.manager [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] Determined volume DB was empty at startup.
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG cinder.volume.manager [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=74426) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Feb 28 04:36:23 devstack cinder-volume[74426]: INFO cinder.volume.manager [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] Service not found for updating active_backend_id, assuming default for driver init.
Feb 28 04:36:23 devstack cinder-volume[74426]: WARNING stevedore.named [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Feb 28 04:36:23 devstack cinder-volume[74426]: WARNING castellan.key_manager [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Feb 28 04:36:23 devstack cinder-volume[74426]: WARNING cinder.keymgr.conf_key_mgr [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG cinder.volume.drivers.lvm [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=74426) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_concurrency.processutils [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=74426) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_concurrency.processutils [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] CMD "cinder-rtstool verify" returned: 0 in 0.235s {{(pid=74426) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_db.sqlalchemy.engines [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74426) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 28 04:36:23 devstack cinder-volume[74426]: INFO cinder.rpc [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Feb 28 04:36:23 devstack cinder-volume[74426]: INFO cinder.rpc [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Feb 28 04:36:23 devstack cinder-volume[74426]: WARNING stevedore.named [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Feb 28 04:36:23 devstack cinder-volume[74426]: WARNING castellan.key_manager [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Feb 28 04:36:23 devstack cinder-volume[74426]: INFO cinder.volume.manager [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_db.sqlalchemy.engines [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74426) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 28 04:36:23 devstack cinder-volume[74426]: INFO oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] Starting 1 workers
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] Started child 74526 {{(pid=74426) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] Full set of CONF: {{(pid=74426) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] ******************************************************************************** {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] Configuration options gathered from: {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] ================================================================================ {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] allow_availability_zone_fallback = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74526]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0)
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] allow_compression_on_image_upload = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] allowed_direct_url_schemes     = [] {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] api_rate_limit                 = True {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] auth_strategy                  = keystone {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] az_cache_duration              = 3600 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_availability_zone      = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_host                   = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_name                   = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_stats_polling_interval = 60 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backup_api_class               = cinder.backup.api.API {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backup_name_template           = backup-%s {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backup_use_same_host           = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backup_use_temp_snapshot       = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] chap_password                  = **** {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] chap_username                  =  {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cinder_internal_tenant_project_id = 0af82309d2de49b7bd6a61c7ee44fba2 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cinder_internal_tenant_user_id = 459ea5d57a094c7281b665606101a500 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cloned_volume_same_az          = True {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cluster                        = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] compression_format             = gzip {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] compute_api_class              = cinder.compute.nova.API {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] config_dir                     = [] {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] config_source                  = [] {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] control_exchange               = openstack {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] debug                          = True {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] default_availability_zone      = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] default_group_type             = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] default_volume_type            = lvmdriver-1 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] disk_geometry                  = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] driver_client_cert             = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] driver_client_cert_key         = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] driver_data_namespace          = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] driver_ssl_cert_path           = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] driver_ssl_cert_verify         = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] driver_use_ssl                 = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] enable_force_upload            = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] enable_new_services            = True {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] enable_unsupported_driver      = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] enforce_multipath_for_image_xfer = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] filter_function                = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] glance_api_insecure            = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] glance_api_servers             = ['http://192.168.122.41/image'] {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] glance_api_ssl_compression     = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] glance_ca_certificates_file    = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] glance_catalog_info            = image:glance:publicURL {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] glance_certfile                = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] glance_keyfile                 = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] glance_num_retries             = 3 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] glance_request_timeout         = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] goodness_function              = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] graceful_shutdown_timeout      = 5 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] group_api_class                = cinder.group.api.API {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] host                           = devstack {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] image_compress_on_upload       = True {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] image_conversion_address_space_limit = 1 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] image_conversion_cpu_limit     = 60 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] image_conversion_disable       = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] image_upload_use_cinder_backend = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] image_upload_use_internal_tenant = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] image_volume_cache_enabled     = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] image_volume_cache_max_count   = 0 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] image_volume_cache_max_size_gb = 0 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] init_host_max_objects_retrieval = 0 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] iscsi_target_flags             =  {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] iscsi_write_cache              = on {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] iser_helper                    = tgtadm {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] iser_ip_address                = 192.168.122.41 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] iser_port                      = 3260 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] log_color                      = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] log_config_append              = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] log_dir                        = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74526]: INFO cinder.volume.manager [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] log_file                       = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] log_options                    = True {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] log_rotate_interval            = 1 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] log_rotate_interval_type       = days {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] log_rotation_type              = none {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] max_age                        = 0 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] max_logfile_count              = 30 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] max_logfile_size_mb            = 200 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] max_over_subscription_ratio    = 20.0 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] message_reap_interval          = 86400 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] message_ttl                    = 2592000 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] migration_create_volume_timeout_secs = 300 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] monkey_patch                   = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] monkey_patch_modules           = [] {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] my_ip                          = 192.168.122.41 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] no_snapshot_gb_quota           = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] num_iser_scan_tries            = 3 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] num_shell_tries                = 3 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] num_volume_device_scan_tries   = 3 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] nvmeof_conn_info_version       = 1 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] nvmet_ns_id                    = 10 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] nvmet_port_id                  = 1 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] osapi_max_limit                = 1000 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] osapi_volume_ext_list          = [] {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] osapi_volume_listen_port       = 8776 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] osapi_volume_use_ssl           = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] osapi_volume_workers           = 2 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] per_volume_size_limit          = -1 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] periodic_fuzzy_delay           = 60 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] periodic_interval              = 60 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] public_endpoint                = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] publish_errors                 = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] quota_backup_gigabytes         = 1000 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] quota_backups                  = 10 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] quota_gigabytes                = 1000 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] quota_groups                   = 10 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] quota_snapshots                = 10 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] quota_volumes                  = 10 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] rate_limit_burst               = 0 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] rate_limit_except_level        = CRITICAL {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] rate_limit_interval            = 0 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] reinit_driver_count            = 3 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] replication_device             = **** {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] report_discard_supported       = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] report_interval                = 120 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] reservation_clean_interval     = 86400 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] reservation_expire             = 86400 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] reserved_image_namespaces      = [] {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] reserved_percentage            = 0 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] rpc_response_timeout           = 120 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] run_external_periodic_tasks    = True {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] scst_target_driver             = iscsi {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] scst_target_iqn_name           = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] service_down_time              = 720 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] shell_completion               = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] snapshot_name_template         = snapshot-%s {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] snapshot_same_host             = True {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] split_loggers                  = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] state_path                     = /opt/stack/data/cinder {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] storage_availability_zone      = nova {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] storage_protocol               = iSCSI {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] syslog_log_facility            = LOG_USER {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] target_helper                  = lioadm {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] target_ip_address              = 192.168.122.41 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] target_port                    = 3260 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] target_protocol                = iscsi {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] target_secondary_ip_addresses  = [] {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] trace_flags                    = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] transport_url                  = **** {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] until_refresh                  = 0 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] use_chap_auth                  = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] use_default_quota_class        = True {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] use_journal                    = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] use_json                       = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] use_multipath_for_image_xfer   = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] use_stderr                     = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] use_syslog                     = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] verify_glance_signatures       = enabled {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] volume_api_class               = cinder.volume.api.API {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] volume_backend_name            = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] volume_clear                   = zero {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] volume_clear_ionice            = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] volume_clear_size              = 0 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] volume_copy_bps_limit          = 0 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] volume_dd_blocksize            = 1M {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] volume_name_template           = volume-%s {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] volume_service_inithost_offload = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] volume_usage_audit_period      = month {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] zoning_mode                    = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_concurrency.disable_process_locking = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.admin_password = **** {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.admin_token = **** {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.admin_user  = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.auth_port   = 35357 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.auth_protocol = https {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.auth_section = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.auth_type   = password {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.auth_uri    = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.auth_version = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.cache       = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.certfile    = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.identity_uri = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.include_service_catalog = True {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.insecure    = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.interface   = public {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.keyfile     = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.memcache_password =  {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.memcache_username =  {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.region_name = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.service_token_roles_required = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.service_type = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.41/identity {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cache.backend                  = dogpile.cache.null {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cache.backend_argument         = **** {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cache.backend_expiration_time  = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cache.config_prefix            = cache.oslo {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cache.debug_cache_backend      = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cache.enable_retry_client      = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cache.enable_socket_keepalive  = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cache.enabled                  = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cache.enforce_fips_mode        = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cache.expiration_time          = 600 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cache.hashclient_retry_attempts = 2 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:36:23 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cache.memcache_dead_retry      = 300 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cache.memcache_sasl_enabled    = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cache.password                 = **** {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cache.proxies                  = [] {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cache.redis_db                 = 0 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cache.redis_server             = localhost:6379 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cache.retry_attempts           = 2 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cache.retry_delay              = 0.0 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cache.socket_keepalive_count   = 1 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cache.socket_keepalive_idle    = 1 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cache.socket_keepalive_interval = 1 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cache.socket_timeout           = 1.0 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cache.tls_allowed_ciphers      = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cache.tls_cafile               = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cache.tls_certfile             = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cache.tls_enabled              = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cache.tls_keyfile              = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cache.username                 = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] coordination.backend_url       = **** {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] database.asyncio_connection    = **** {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] database.asyncio_slave_connection = **** {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] database.backend               = sqlalchemy {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] database.connection            = **** {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] database.connection_debug      = 0 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] database.connection_parameters =  {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] database.connection_recycle_time = 3600 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] database.connection_trace      = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] database.db_inc_retry_interval = True {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] database.db_max_retries        = 20 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] database.db_max_retry_interval = 10 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] database.db_retry_interval     = 1 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] database.max_overflow          = 50 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] database.max_pool_size         = 5 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] database.max_retries           = 10 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] database.mysql_wsrep_sync_wait = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] database.pool_timeout          = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] database.retry_interval        = 10 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] database.slave_connection      = **** {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] database.sqlite_synchronous    = True {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] database.synchronous_reader    = True {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] database.use_db_reconnect      = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] profiler.connection_string     = messaging:// {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] profiler.enabled               = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] profiler.es_doc_type           = notification {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] profiler.es_scroll_size        = 10000 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] profiler.es_scroll_time        = 2m {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] profiler.filter_error_trace    = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] profiler.hmac_keys             = **** {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] profiler.sentinel_service_name = mymaster {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] profiler.socket_timeout        = 0.1 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] profiler.trace_requests        = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] profiler.trace_sqlalchemy      = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] profiler_jaeger.process_tags   = {} {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] profiler_jaeger.service_name_prefix = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] profiler_otlp.service_name_prefix = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_policy.enforce_new_defaults = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:36:23 devstack cinder-volume[74426]: WARNING oslo_config.cfg [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_policy.enforce_scope      = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_policy.policy_default_rule = default {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] privsep_osbrick.group          = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] privsep_osbrick.helper_command = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] privsep_osbrick.user           = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cinder_sys_admin.group         = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cinder_sys_admin.helper_command = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] cinder_sys_admin.user          = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] service_user.auth_section      = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] service_user.auth_type         = password {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] service_user.cafile            = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] service_user.certfile          = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] service_user.collect_timing    = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] service_user.insecure          = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] service_user.keyfile           = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] service_user.send_service_user_token = True {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] service_user.split_loggers     = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] service_user.timeout           = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] glance.auth_section            = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] glance.auth_type               = password {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] glance.certfile                = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] glance.collect_timing          = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] glance.insecure                = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] glance.keyfile                 = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] glance.region_name             = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] glance.split_loggers           = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] glance.timeout                 = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.backend_availability_zone = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.chap_password = **** {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.chap_username =  {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.disk_geometry = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.driver_client_cert = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.driver_client_cert_key = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.driver_data_namespace = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:23 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.driver_use_ssl = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.extra_capabilities = {} {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.filter_function = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.goodness_function = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.iscsi_target_flags =  {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.iscsi_write_cache = on {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.iser_helper   = tgtadm {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.iser_ip_address = 192.168.122.41 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.iser_port     = 3260 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.lvm_share_target = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.lvm_type      = auto {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.num_shell_tries = 3 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack sudo[74536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Feb 28 04:36:24 devstack sudo[74536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.replication_device = **** {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.report_discard_supported = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.reserved_percentage = 0 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.target_helper = tgtadm {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.target_ip_address = 192.168.122.41 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.target_port   = 3260 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.target_protocol = iscsi {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.trace_flags   = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.unique_fqdn_network = True {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.use_chap_auth = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.volume_backend_name = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.volume_clear  = zero {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.volume_clear_ionice = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.volume_clear_size = 0 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_reports.file_event_handler = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_reports.log_dir           = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.backend_availability_zone = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.backend_host       = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.chap_password      = **** {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.chap_username      = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.disk_geometry      = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.driver_client_cert = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.driver_data_namespace = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.extra_capabilities = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.filter_function    = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.goodness_function  = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.iser_helper        = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.iser_ip_address    = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.iser_port          = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.iser_target_prefix = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.lvm_share_target   = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.lvm_type           = auto {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.num_shell_tries    = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.replication_device = **** {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.report_discard_supported = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.reserved_percentage = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.scst_target_driver = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.storage_protocol   = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.target_helper      = lioadm {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.target_ip_address  = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.target_port        = 3260 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.trace_flags        = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.use_chap_auth      = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.volume_clear       = zero {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.volume_clear_size  = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] lvmdriver-1.volumes_dir        = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_messaging_notifications.driver = [] {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_messaging_notifications.retry = -1 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] key_manager.fixed_key          = **** {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] barbican.barbican_api_version  = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] barbican.barbican_endpoint     = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] barbican.barbican_endpoint_type = public {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] barbican.barbican_region_name  = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] barbican.cafile                = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] barbican.certfile              = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] barbican.collect_timing        = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] barbican.insecure              = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] barbican.keyfile               = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] barbican.number_of_retries     = 60 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] barbican.retry_delay           = 1 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] barbican.send_service_user_token = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] barbican.split_loggers         = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] barbican.timeout               = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] barbican.verify_ssl            = True {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] barbican.verify_ssl_path       = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] barbican_service_user.auth_section = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] barbican_service_user.auth_type = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] barbican_service_user.cafile   = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] barbican_service_user.certfile = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] barbican_service_user.collect_timing = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] barbican_service_user.insecure = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] barbican_service_user.keyfile  = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] barbican_service_user.split_loggers = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] barbican_service_user.timeout  = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] vault.approle_role_id          = **** {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] vault.approle_secret_id        = **** {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] vault.kv_mountpoint            = secret {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] vault.kv_path                  = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] vault.kv_version               = 2 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] vault.namespace                = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] vault.root_token_id            = **** {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] vault.ssl_ca_crt_file          = None {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] vault.timeout                  = 60.0 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] vault.use_ssl                  = False {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:36:24 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] ******************************************************************************** {{(pid=74426) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Feb 28 04:36:24 devstack sudo[74536]: pam_unix(sudo:session): session closed for user root
Feb 28 04:36:24 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.538s {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:36:24 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:36:24 devstack sudo[74645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 28 04:36:24 devstack sudo[74645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:36:25 devstack sudo[74645]: pam_unix(sudo:session): session closed for user root
Feb 28 04:36:25 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.504s {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:36:25 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 28 04:36:25 devstack cinder-volume[74526]: INFO cinder.brick.local_dev.lvm [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Feb 28 04:36:25 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:36:25 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:36:25 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:36:25 devstack sudo[74857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Feb 28 04:36:25 devstack sudo[74857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:36:25 devstack sudo[74857]: pam_unix(sudo:session): session closed for user root
Feb 28 04:36:25 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.602s {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:36:25 devstack cinder-volume[74526]: DEBUG cinder.brick.local_dev.lvm [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=74526) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Feb 28 04:36:25 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:36:25 devstack sudo[75047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 28 04:36:25 devstack sudo[75047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:36:26 devstack sudo[75047]: pam_unix(sudo:session): session closed for user root
Feb 28 04:36:26 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.904s {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:36:26 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:36:26 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:36:26 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:36:26 devstack sudo[75159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 28 04:36:26 devstack sudo[75159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:36:27 devstack sudo[75159]: pam_unix(sudo:session): session closed for user root
Feb 28 04:36:27 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.493s {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:36:27 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:36:27 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:36:27 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:36:27 devstack sudo[75220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Feb 28 04:36:27 devstack sudo[75220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:36:27 devstack sudo[75220]: pam_unix(sudo:session): session closed for user root
Feb 28 04:36:27 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.478s {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:36:27 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:36:27 devstack sudo[75223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Feb 28 04:36:27 devstack sudo[75223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:36:28 devstack sudo[75223]: pam_unix(sudo:session): session closed for user root
Feb 28 04:36:28 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.425s {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:36:28 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:36:28 devstack sudo[75231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Feb 28 04:36:28 devstack sudo[75231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:36:28 devstack sudo[75231]: pam_unix(sudo:session): session closed for user root
Feb 28 04:36:28 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.441s {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:36:28 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:36:28 devstack sudo[75234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 28 04:36:28 devstack sudo[75234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:36:28 devstack sudo[75234]: pam_unix(sudo:session): session closed for user root
Feb 28 04:36:28 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.415s {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:36:28 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:36:28 devstack sudo[75239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 28 04:36:28 devstack sudo[75239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:36:29 devstack sudo[75239]: pam_unix(sudo:session): session closed for user root
Feb 28 04:36:29 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.439s {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:36:29 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:36:29 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:36:29 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:36:29 devstack sudo[75243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 28 04:36:29 devstack sudo[75243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:36:29 devstack sudo[75243]: pam_unix(sudo:session): session closed for user root
Feb 28 04:36:29 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.459s {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:36:29 devstack cinder-volume[74526]: INFO cinder.volume.drivers.lvm [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Feb 28 04:36:29 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:36:29 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:36:29 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:36:29 devstack sudo[75256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 28 04:36:29 devstack sudo[75256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:36:30 devstack sudo[75256]: pam_unix(sudo:session): session closed for user root
Feb 28 04:36:30 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.485s {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:36:30 devstack cinder-volume[74526]: DEBUG cinder.volume.drivers.lvm [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Updating volume stats {{(pid=74526) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Feb 28 04:36:30 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:36:30 devstack sudo[75368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Feb 28 04:36:30 devstack sudo[75368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:36:30 devstack sudo[75368]: pam_unix(sudo:session): session closed for user root
Feb 28 04:36:30 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.451s {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:36:30 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:36:30 devstack sudo[75372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 28 04:36:30 devstack sudo[75372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:36:31 devstack sudo[75372]: pam_unix(sudo:session): session closed for user root
Feb 28 04:36:31 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.446s {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:36:31 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:36:31 devstack sudo[75510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 28 04:36:31 devstack sudo[75510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:36:31 devstack sudo[75510]: pam_unix(sudo:session): session closed for user root
Feb 28 04:36:31 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.442s {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:36:31 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:36:31 devstack sudo[75516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 28 04:36:31 devstack sudo[75516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:36:32 devstack sudo[75516]: pam_unix(sudo:session): session closed for user root
Feb 28 04:36:32 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.425s {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:36:32 devstack cinder-volume[74526]: INFO cinder.volume.driver [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Driver hasn't implemented _init_vendor_properties()
Feb 28 04:36:32 devstack cinder-volume[74526]: DEBUG cinder.volume.driver [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=74526) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Feb 28 04:36:32 devstack cinder-volume[74526]: DEBUG oslo_db.sqlalchemy.engines [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74526) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 28 04:36:32 devstack cinder-volume[74526]: DEBUG dbcounter [-] [74526] Writer thread running {{(pid=74526) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Feb 28 04:36:32 devstack cinder-volume[74526]: DEBUG cinder.db.sqlalchemy.api [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Building query based on filter {{(pid=74526) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Feb 28 04:36:32 devstack cinder-volume[74526]: DEBUG cinder.image.image_utils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=74526) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Feb 28 04:36:32 devstack cinder-volume[74526]: INFO cinder.keymgr.migration [None req-f3d65f37-d1d0-48fe-adf9-69b0f2f8f9db None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Feb 28 04:36:32 devstack cinder-volume[74526]: DEBUG cinder.volume.drivers.lvm [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Updating volume stats {{(pid=74526) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Feb 28 04:36:32 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:36:32 devstack sudo[75522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Feb 28 04:36:32 devstack sudo[75522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:36:32 devstack sudo[75522]: pam_unix(sudo:session): session closed for user root
Feb 28 04:36:32 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.419s {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:36:32 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:36:32 devstack sudo[75525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 28 04:36:32 devstack sudo[75525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:36:32 devstack sudo[75525]: pam_unix(sudo:session): session closed for user root
Feb 28 04:36:33 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.427s {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:36:33 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:36:33 devstack sudo[75528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 28 04:36:33 devstack sudo[75528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:36:33 devstack sudo[75528]: pam_unix(sudo:session): session closed for user root
Feb 28 04:36:33 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.438s {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:36:33 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:36:33 devstack sudo[75532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 28 04:36:33 devstack sudo[75532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:36:33 devstack cinder-volume[74426]: DEBUG dbcounter [-] [74426] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=74426) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 04:36:33 devstack sudo[75532]: pam_unix(sudo:session): session closed for user root
Feb 28 04:36:33 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.524s {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:36:33 devstack cinder-volume[74526]: DEBUG cinder.manager [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Notifying Schedulers of capabilities ... {{(pid=74526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:36:33 devstack cinder-volume[74526]: INFO cinder.volume.manager [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Driver initialization completed successfully.
Feb 28 04:36:33 devstack cinder-volume[74526]: INFO cinder.manager [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Initiating service 2 cleanup
Feb 28 04:36:33 devstack cinder-volume[74526]: INFO cinder.manager [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Service 2 cleanup completed.
Feb 28 04:36:33 devstack cinder-volume[74526]: DEBUG cinder.service [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Creating RPC server for service cinder-volume {{(pid=74526) start /opt/stack/cinder/cinder/service.py:231}}
Feb 28 04:36:33 devstack cinder-volume[74526]: DEBUG cinder.service [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=74526) start /opt/stack/cinder/cinder/service.py:237}}
Feb 28 04:36:34 devstack cinder-volume[74526]: INFO cinder.volume.manager [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Feb 28 04:36:34 devstack cinder-volume[74526]: DEBUG cinder.volume.drivers.lvm [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Updating volume stats {{(pid=74526) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Feb 28 04:36:34 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:36:34 devstack sudo[75541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Feb 28 04:36:34 devstack sudo[75541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:36:34 devstack sudo[75541]: pam_unix(sudo:session): session closed for user root
Feb 28 04:36:34 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.510s {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:36:34 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:36:34 devstack sudo[75545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 28 04:36:34 devstack sudo[75545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:36:35 devstack sudo[75545]: pam_unix(sudo:session): session closed for user root
Feb 28 04:36:35 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.470s {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:36:35 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:36:35 devstack sudo[75548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 28 04:36:35 devstack sudo[75548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:36:35 devstack sudo[75548]: pam_unix(sudo:session): session closed for user root
Feb 28 04:36:35 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.456s {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:36:35 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:36:35 devstack sudo[75628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 28 04:36:35 devstack sudo[75628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:36:35 devstack sudo[75628]: pam_unix(sudo:session): session closed for user root
Feb 28 04:36:35 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.428s {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:36:35 devstack cinder-volume[74526]: INFO cinder.volume.manager [None req-94a4071f-a2c4-4689-ac6b-5a1b98a97687 None None] Driver post RPC initialization completed successfully.
Feb 28 04:36:45 devstack cinder-volume[74526]: DEBUG dbcounter [-] [74526] Writing DB stats cinder:SELECT=3 {{(pid=74526) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 04:36:45 devstack cinder-volume[74526]: DEBUG dbcounter [-] [74526] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=74526) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 04:38:06 devstack cinder-volume[74526]: DEBUG oslo_service.periodic_task [None req-085cc199-a06b-4d89-8e10-fb8e3b212e66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74526) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 28 04:38:06 devstack cinder-volume[74526]: DEBUG cinder.volume.drivers.lvm [None req-085cc199-a06b-4d89-8e10-fb8e3b212e66 None None] Updating volume stats {{(pid=74526) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Feb 28 04:38:06 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-085cc199-a06b-4d89-8e10-fb8e3b212e66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:38:06 devstack sudo[80654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Feb 28 04:38:06 devstack sudo[80654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:38:07 devstack sudo[80654]: pam_unix(sudo:session): session closed for user root
Feb 28 04:38:07 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-085cc199-a06b-4d89-8e10-fb8e3b212e66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.429s {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:38:07 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-085cc199-a06b-4d89-8e10-fb8e3b212e66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:38:07 devstack sudo[80658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 28 04:38:07 devstack sudo[80658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:38:07 devstack sudo[80658]: pam_unix(sudo:session): session closed for user root
Feb 28 04:38:07 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-085cc199-a06b-4d89-8e10-fb8e3b212e66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.429s {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:38:07 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-085cc199-a06b-4d89-8e10-fb8e3b212e66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:38:07 devstack sudo[80666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 28 04:38:07 devstack sudo[80666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:38:08 devstack sudo[80666]: pam_unix(sudo:session): session closed for user root
Feb 28 04:38:08 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-085cc199-a06b-4d89-8e10-fb8e3b212e66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.426s {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:38:08 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-085cc199-a06b-4d89-8e10-fb8e3b212e66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:38:08 devstack sudo[80672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 28 04:38:08 devstack sudo[80672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:38:08 devstack sudo[80672]: pam_unix(sudo:session): session closed for user root
Feb 28 04:38:08 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-085cc199-a06b-4d89-8e10-fb8e3b212e66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.435s {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:38:08 devstack cinder-volume[74526]: DEBUG cinder.manager [None req-085cc199-a06b-4d89-8e10-fb8e3b212e66 None None] Notifying Schedulers of capabilities ... {{(pid=74526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:38:45 devstack cinder-volume[74526]: DEBUG dbcounter [-] [74526] Writing DB stats cinder:SELECT=1 {{(pid=74526) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 04:38:45 devstack cinder-volume[74526]: DEBUG dbcounter [-] [74526] Writing DB stats cinder:UPDATE=1 {{(pid=74526) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 04:39:06 devstack cinder-volume[74526]: DEBUG oslo_service.periodic_task [None req-085cc199-a06b-4d89-8e10-fb8e3b212e66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74526) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 28 04:39:06 devstack cinder-volume[74526]: DEBUG cinder.volume.drivers.lvm [None req-085cc199-a06b-4d89-8e10-fb8e3b212e66 None None] Updating volume stats {{(pid=74526) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Feb 28 04:39:06 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-085cc199-a06b-4d89-8e10-fb8e3b212e66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:39:06 devstack sudo[82479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Feb 28 04:39:06 devstack sudo[82479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:39:07 devstack sudo[82479]: pam_unix(sudo:session): session closed for user root
Feb 28 04:39:07 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-085cc199-a06b-4d89-8e10-fb8e3b212e66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.422s {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:39:07 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-085cc199-a06b-4d89-8e10-fb8e3b212e66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:39:07 devstack sudo[82485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 28 04:39:07 devstack sudo[82485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:39:07 devstack sudo[82485]: pam_unix(sudo:session): session closed for user root
Feb 28 04:39:07 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-085cc199-a06b-4d89-8e10-fb8e3b212e66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.413s {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:39:07 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-085cc199-a06b-4d89-8e10-fb8e3b212e66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:39:07 devstack sudo[82488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 28 04:39:07 devstack sudo[82488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:39:08 devstack sudo[82488]: pam_unix(sudo:session): session closed for user root
Feb 28 04:39:08 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-085cc199-a06b-4d89-8e10-fb8e3b212e66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.424s {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:39:08 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-085cc199-a06b-4d89-8e10-fb8e3b212e66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:39:08 devstack sudo[82492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 28 04:39:08 devstack sudo[82492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:39:08 devstack sudo[82492]: pam_unix(sudo:session): session closed for user root
Feb 28 04:39:08 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-085cc199-a06b-4d89-8e10-fb8e3b212e66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.423s {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:39:08 devstack cinder-volume[74526]: DEBUG cinder.manager [None req-085cc199-a06b-4d89-8e10-fb8e3b212e66 None None] Notifying Schedulers of capabilities ... {{(pid=74526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:40:05 devstack cinder-volume[74426]: INFO oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] Caught SIGTERM, stopping children
Feb 28 04:40:05 devstack cinder-volume[74426]: DEBUG oslo_concurrency.lockutils [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] Acquiring lock "singleton_lock" {{(pid=74426) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Feb 28 04:40:05 devstack cinder-volume[74426]: DEBUG oslo_concurrency.lockutils [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] Acquired lock "singleton_lock" {{(pid=74426) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Feb 28 04:40:05 devstack cinder-volume[74426]: DEBUG oslo_concurrency.lockutils [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] Releasing lock "singleton_lock" {{(pid=74426) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Feb 28 04:40:05 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] Stop services. {{(pid=74426) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Feb 28 04:40:05 devstack cinder-volume[74426]: DEBUG oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] Killing children. {{(pid=74426) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Feb 28 04:40:05 devstack cinder-volume[74426]: INFO oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] Waiting on 1 children to exit
Feb 28 04:40:06 devstack cinder-volume[74526]: DEBUG oslo_service.periodic_task [None req-085cc199-a06b-4d89-8e10-fb8e3b212e66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74526) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 28 04:40:06 devstack cinder-volume[74526]: DEBUG cinder.volume.drivers.lvm [None req-085cc199-a06b-4d89-8e10-fb8e3b212e66 None None] Updating volume stats {{(pid=74526) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Feb 28 04:40:06 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-085cc199-a06b-4d89-8e10-fb8e3b212e66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:40:06 devstack sudo[83696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Feb 28 04:40:06 devstack sudo[83696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:40:07 devstack sudo[83696]: pam_unix(sudo:session): session closed for user root
Feb 28 04:40:07 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-085cc199-a06b-4d89-8e10-fb8e3b212e66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.434s {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:40:07 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-085cc199-a06b-4d89-8e10-fb8e3b212e66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:40:07 devstack sudo[83699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 28 04:40:07 devstack sudo[83699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:40:07 devstack sudo[83699]: pam_unix(sudo:session): session closed for user root
Feb 28 04:40:07 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-085cc199-a06b-4d89-8e10-fb8e3b212e66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.425s {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:40:07 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-085cc199-a06b-4d89-8e10-fb8e3b212e66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:40:07 devstack sudo[83702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 28 04:40:07 devstack sudo[83702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:40:08 devstack sudo[83702]: pam_unix(sudo:session): session closed for user root
Feb 28 04:40:08 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-085cc199-a06b-4d89-8e10-fb8e3b212e66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.429s {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:40:08 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-085cc199-a06b-4d89-8e10-fb8e3b212e66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:40:08 devstack sudo[83705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 28 04:40:08 devstack sudo[83705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:40:08 devstack sudo[83705]: pam_unix(sudo:session): session closed for user root
Feb 28 04:40:08 devstack cinder-volume[74526]: DEBUG oslo_concurrency.processutils [None req-085cc199-a06b-4d89-8e10-fb8e3b212e66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.428s {{(pid=74526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:40:08 devstack cinder-volume[74526]: DEBUG cinder.manager [None req-085cc199-a06b-4d89-8e10-fb8e3b212e66 None None] Notifying Schedulers of capabilities ... {{(pid=74526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:40:09 devstack cinder-volume[74526]: DEBUG oslo_concurrency.lockutils [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] Acquiring lock "singleton_lock" {{(pid=74526) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Feb 28 04:40:09 devstack cinder-volume[74526]: DEBUG oslo_concurrency.lockutils [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] Acquired lock "singleton_lock" {{(pid=74526) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Feb 28 04:40:09 devstack cinder-volume[74526]: DEBUG oslo_concurrency.lockutils [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] Releasing lock "singleton_lock" {{(pid=74526) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Feb 28 04:40:09 devstack cinder-volume[74526]: WARNING amqp [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Feb 28 04:40:09 devstack cinder-volume[74526]: WARNING amqp [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Feb 28 04:40:09 devstack cinder-volume[74426]: INFO oslo_service.backend._eventlet.service [None req-10629782-628a-4a04-8120-ba934cbd6ab2 None None] Child 74526 exited with status 0
Feb 28 04:40:11 devstack cinder-volume[83708]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83708) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Feb 28 04:40:11 devstack cinder-volume[83708]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83708) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Feb 28 04:40:11 devstack cinder-volume[83708]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83708) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Feb 28 04:40:11 devstack cinder-volume[83708]: INFO dbcounter [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] Registered counter for database cinder
Feb 28 04:40:11 devstack cinder-volume[83708]: DEBUG oslo_db.sqlalchemy.engines [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83708) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG dbcounter [-] [83708] Writer thread running {{(pid=83708) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Feb 28 04:40:12 devstack cinder-volume[83708]: INFO cinder.rpc [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Feb 28 04:40:12 devstack cinder-volume[83708]: INFO cinder.rpc [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_db.sqlalchemy.engines [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83708) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 28 04:40:12 devstack cinder-volume[83708]: INFO cinder.volume.manager [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] Determined volume DB was empty at startup.
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG cinder.volume.manager [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83708) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Feb 28 04:40:12 devstack cinder-volume[83708]: INFO cinder.volume.manager [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] Service not found for updating active_backend_id, assuming default for driver init.
Feb 28 04:40:12 devstack cinder-volume[83708]: WARNING stevedore.named [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Feb 28 04:40:12 devstack cinder-volume[83708]: WARNING castellan.key_manager [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Feb 28 04:40:12 devstack cinder-volume[83708]: WARNING cinder.keymgr.conf_key_mgr [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Feb 28 04:40:12 devstack cinder-volume[83708]: INFO cinder.volume.manager [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] Image-volume cache disabled for host devstack@QuobyteHD.
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_db.sqlalchemy.engines [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83708) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 28 04:40:12 devstack cinder-volume[83708]: INFO oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] Starting 1 workers
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] Started child 83826 {{(pid=83708) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] Full set of CONF: {{(pid=83708) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] ******************************************************************************** {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] Configuration options gathered from: {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] ================================================================================ {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] allow_availability_zone_fallback = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] allow_compression_on_image_upload = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] allowed_direct_url_schemes     = [] {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] api_rate_limit                 = True {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] auth_strategy                  = keystone {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_availability_zone      = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_host                   = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_name                   = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_stats_polling_interval = 60 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backup_api_class               = cinder.backup.api.API {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backup_name_template           = backup-%s {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backup_use_same_host           = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backup_use_temp_snapshot       = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] chap_password                  = **** {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] chap_username                  =  {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cinder_internal_tenant_project_id = 0af82309d2de49b7bd6a61c7ee44fba2 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cinder_internal_tenant_user_id = 459ea5d57a094c7281b665606101a500 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cluster                        = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] compression_format             = gzip {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] compute_api_class              = cinder.compute.nova.API {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] config_dir                     = [] {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] config_source                  = [] {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] control_exchange               = openstack {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] debug                          = True {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] default_availability_zone      = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] default_group_type             = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] default_volume_type            = QuobyteHD {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] disk_geometry                  = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] driver_client_cert             = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] driver_client_cert_key         = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] driver_data_namespace          = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] driver_ssl_cert_path           = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] driver_ssl_cert_verify         = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] driver_use_ssl                 = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] enable_new_services            = True {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] enable_unsupported_driver      = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] enabled_backends               = ['QuobyteHD'] {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] enforce_multipath_for_image_xfer = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] filter_function                = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] glance_api_insecure            = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] glance_api_servers             = ['http://192.168.122.41/image'] {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] glance_api_ssl_compression     = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] glance_ca_certificates_file    = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] glance_catalog_info            = image:glance:publicURL {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] glance_certfile                = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83826]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0)
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] glance_keyfile                 = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] glance_num_retries             = 3 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] glance_request_timeout         = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] goodness_function              = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] graceful_shutdown_timeout      = 5 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] group_api_class                = cinder.group.api.API {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] host                           = devstack {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] image_compress_on_upload       = True {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] image_conversion_address_space_limit = 1 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] image_conversion_cpu_limit     = 60 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] image_conversion_disable       = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] image_upload_use_cinder_backend = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] image_upload_use_internal_tenant = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] image_volume_cache_enabled     = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] image_volume_cache_max_count   = 0 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] image_volume_cache_max_size_gb = 0 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] init_host_max_objects_retrieval = 0 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] instance_format                = [instance: %(uuid)s]  {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] iscsi_target_flags             =  {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] iscsi_write_cache              = on {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] iser_helper                    = tgtadm {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] iser_ip_address                = 192.168.122.41 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] iser_port                      = 3260 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] log_color                      = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] log_config_append              = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] log_dir                        = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] log_file                       = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] log_options                    = True {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] log_rotate_interval            = 1 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] log_rotate_interval_type       = days {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] log_rotation_type              = none {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] max_age                        = 0 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] max_logfile_count              = 30 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] max_logfile_size_mb            = 200 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] max_over_subscription_ratio    = 20.0 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] message_reap_interval          = 86400 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] message_ttl                    = 2592000 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] migration_create_volume_timeout_secs = 300 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] monkey_patch                   = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] monkey_patch_modules           = [] {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] my_ip                          = 192.168.122.41 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] no_snapshot_gb_quota           = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] num_iser_scan_tries            = 3 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] num_shell_tries                = 3 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] num_volume_device_scan_tries   = 3 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] nvmeof_conn_info_version       = 1 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] nvmet_ns_id                    = 10 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] nvmet_port_id                  = 1 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] osapi_max_limit                = 1000 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] osapi_volume_ext_list          = [] {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] osapi_volume_listen            = 0.0.0.0 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] osapi_volume_listen_port       = 8776 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] osapi_volume_use_ssl           = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] osapi_volume_workers           = 2 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] per_volume_size_limit          = -1 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] periodic_fuzzy_delay           = 60 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] periodic_interval              = 60 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] project_id_regex               = [0-9a-f\-]+ {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] public_endpoint                = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] publish_errors                 = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] quota_backup_gigabytes         = 1000 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] quota_backups                  = 10 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] quota_gigabytes                = 1000 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] quota_groups                   = 10 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] quota_snapshots                = 10 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] quota_volumes                  = 10 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] rate_limit_burst               = 0 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] rate_limit_except_level        = CRITICAL {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] rate_limit_interval            = 0 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] reinit_driver_count            = 3 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] replication_device             = **** {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] report_discard_supported       = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] report_interval                = 120 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] reservation_clean_interval     = 86400 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] reservation_expire             = 86400 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] reserved_image_namespaces      = [] {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] reserved_percentage            = 0 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] rpc_response_timeout           = 120 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] run_external_periodic_tasks    = True {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] scst_target_driver             = iscsi {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] scst_target_iqn_name           = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] service_down_time              = 720 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] shell_completion               = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] snapshot_name_template         = snapshot-%s {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] split_loggers                  = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] state_path                     = /opt/stack/data/cinder {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] storage_availability_zone      = nova {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] storage_protocol               = iSCSI {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] syslog_log_facility            = LOG_USER {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] target_helper                  = lioadm {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] target_ip_address              = 192.168.122.41 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] target_port                    = 3260 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] target_protocol                = iscsi {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] target_secondary_ip_addresses  = [] {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] trace_flags                    = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] transfer_api_class             = cinder.transfer.api.API {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] transport_url                  = **** {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] until_refresh                  = 0 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] use_chap_auth                  = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] use_default_quota_class        = True {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] use_journal                    = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] use_json                       = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] use_multipath_for_image_xfer   = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] use_stderr                     = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] use_syslog                     = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] verify_glance_signatures       = enabled {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] volume_api_class               = cinder.volume.api.API {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] volume_backend_name            = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] volume_clear                   = zero {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] volume_clear_ionice            = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] volume_clear_size              = 0 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] volume_copy_bps_limit          = 0 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] volume_dd_blocksize            = 1M {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] volume_name_template           = volume-%s {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] volume_service_inithost_offload = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] volume_usage_audit_period      = month {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] zoning_mode                    = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_concurrency.disable_process_locking = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.admin_password = **** {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.admin_token = **** {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.admin_user  = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.auth_admin_prefix =  {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.auth_port   = 35357 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.auth_protocol = https {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.auth_section = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.auth_type   = password {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.auth_uri    = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.auth_version = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.cache       = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.certfile    = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.delay_auth_decision = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.http_connect_timeout = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.identity_uri = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.include_service_catalog = True {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.insecure    = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.interface   = public {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.keyfile     = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.memcache_password =  {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.memcache_username =  {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.region_name = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.service_token_roles_required = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.service_type = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.token_cache_time = 300 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.41/identity {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cache.backend                  = dogpile.cache.null {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cache.backend_argument         = **** {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cache.backend_expiration_time  = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cache.config_prefix            = cache.oslo {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cache.debug_cache_backend      = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cache.enable_retry_client      = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cache.enable_socket_keepalive  = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cache.enabled                  = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cache.enforce_fips_mode        = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cache.expiration_time          = 600 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cache.hashclient_retry_attempts = 2 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cache.memcache_dead_retry      = 300 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cache.memcache_pool_maxsize    = 10 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cache.memcache_sasl_enabled    = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cache.password                 = **** {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cache.proxies                  = [] {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cache.redis_db                 = 0 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cache.redis_sentinel_service_name = mymaster {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cache.redis_server             = localhost:6379 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cache.retry_attempts           = 2 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cache.retry_delay              = 0.0 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cache.socket_keepalive_count   = 1 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cache.socket_keepalive_idle    = 1 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cache.socket_keepalive_interval = 1 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cache.socket_timeout           = 1.0 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cache.tls_allowed_ciphers      = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cache.tls_cafile               = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cache.tls_certfile             = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cache.tls_enabled              = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cache.tls_keyfile              = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cache.username                 = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] coordination.backend_url       = **** {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] database.asyncio_connection    = **** {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] database.asyncio_slave_connection = **** {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] database.backend               = sqlalchemy {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] database.connection            = **** {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] database.connection_debug      = 0 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] database.connection_parameters =  {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] database.connection_recycle_time = 3600 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] database.connection_trace      = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] database.db_inc_retry_interval = True {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] database.db_max_retries        = 20 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] database.db_max_retry_interval = 10 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] database.db_retry_interval     = 1 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] database.max_overflow          = 50 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] database.max_pool_size         = 5 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] database.max_retries           = 10 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] database.mysql_wsrep_sync_wait = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] database.pool_timeout          = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] database.retry_interval        = 10 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] database.slave_connection      = **** {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] database.sqlite_synchronous    = True {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] database.synchronous_reader    = True {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] database.use_db_reconnect      = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] profiler.connection_string     = messaging:// {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] profiler.enabled               = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] profiler.es_doc_type           = notification {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] profiler.es_scroll_size        = 10000 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] profiler.es_scroll_time        = 2m {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] profiler.filter_error_trace    = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] profiler.hmac_keys             = **** {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] profiler.sentinel_service_name = mymaster {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] profiler.socket_timeout        = 0.1 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] profiler.trace_requests        = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] profiler.trace_sqlalchemy      = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] profiler_jaeger.process_tags   = {} {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] profiler_jaeger.service_name_prefix = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] profiler_otlp.service_name_prefix = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_policy.enforce_new_defaults = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: WARNING oslo_config.cfg [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_policy.enforce_scope      = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_policy.policy_default_rule = default {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_policy.policy_file        = policy.yaml {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_policy.remote_timeout     = 60.0 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] privsep_osbrick.group          = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] privsep_osbrick.helper_command = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] privsep_osbrick.user           = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cinder_sys_admin.group         = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cinder_sys_admin.helper_command = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] cinder_sys_admin.user          = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] service_user.auth_section      = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] service_user.auth_type         = password {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] service_user.cafile            = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] service_user.certfile          = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] service_user.collect_timing    = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] service_user.insecure          = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] service_user.keyfile           = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] service_user.send_service_user_token = True {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] service_user.split_loggers     = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] service_user.timeout           = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] glance.auth_section            = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] glance.auth_type               = password {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] glance.certfile                = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] glance.collect_timing          = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] glance.insecure                = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] glance.keyfile                 = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] glance.region_name             = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] glance.split_loggers           = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] glance.timeout                 = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.backend_availability_zone = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.chap_password = **** {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.chap_username =  {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.disk_geometry = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.driver_client_cert = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.driver_client_cert_key = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.driver_data_namespace = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.driver_use_ssl = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.enable_unsupported_driver = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.extra_capabilities = {} {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.filter_function = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.goodness_function = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.iscsi_target_flags =  {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.iscsi_write_cache = on {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.iser_helper   = tgtadm {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83826]: INFO cinder.volume.manager [None req-9002edb0-1d51-4cb7-898a-20629a746550 None None] Starting volume driver QuobyteDriver (1.1.14)
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.iser_ip_address = 192.168.122.41 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.iser_port     = 3260 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.nas_host      =  {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.nas_login     = admin {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.nas_mount_options = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.nas_password  = **** {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.nas_private_key =  {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.nas_share_path =  {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.nas_ssh_port  = 22 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.num_shell_tries = 3 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.nvmet_port_id = 1 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.quobyte_client_cfg = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.quobyte_volume_url = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.replication_device = **** {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.report_discard_supported = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.reserved_percentage = 0 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.scst_target_driver = iscsi {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.scst_target_iqn_name = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.storage_protocol = iSCSI {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.target_helper = tgtadm {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.target_ip_address = 192.168.122.41 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.target_port   = 3260 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.target_protocol = iscsi {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.trace_flags   = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.unique_fqdn_network = True {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.use_chap_auth = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.volume_backend_name = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.volume_clear  = zero {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.volume_clear_ionice = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.volume_clear_size = 0 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_reports.file_event_handler = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_reports.log_dir           = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.backend_availability_zone = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.backend_host         = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.chap_password        = **** {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.chap_username        = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.chiscsi_conf         = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.disk_geometry        = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.driver_client_cert   = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.driver_client_cert_key = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.driver_data_namespace = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.driver_use_ssl       = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.extra_capabilities   = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.filter_function      = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.goodness_function    = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.iscsi_target_flags   = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.iscsi_write_cache    = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.iser_helper          = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.iser_ip_address      = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.iser_port            = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.iser_target_prefix   = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.nas_host             = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.nas_login            = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.nas_mount_options    = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.nas_password         = **** {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.nas_private_key      = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.nas_share_path       = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.nas_ssh_port         = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.num_shell_tries      = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.nvmet_ns_id          = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.nvmet_port_id        = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.replication_device   = **** {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.report_discard_supported = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.reserved_percentage  = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.scst_target_driver   = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.storage_protocol     = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.target_helper        = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.target_ip_address    = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.target_port          = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.target_prefix        = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.target_protocol      = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83826]: DEBUG cinder.volume.drivers.remotefs [None req-9002edb0-1d51-4cb7-898a-20629a746550 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83826) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.trace_flags          = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.unique_fqdn_network  = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.use_chap_auth        = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.volume_clear         = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.volume_clear_ionice  = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.volume_clear_size    = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] QuobyteHD.volumes_dir          = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_messaging_rabbit.ssl      = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_messaging_rabbit.ssl_version =  {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_messaging_notifications.driver = [] {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_messaging_notifications.retry = -1 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] oslo_messaging_notifications.transport_url = **** {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] key_manager.fixed_key          = **** {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] barbican.barbican_api_version  = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] barbican.barbican_endpoint     = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] barbican.barbican_endpoint_type = public {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] barbican.barbican_region_name  = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] barbican.cafile                = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] barbican.certfile              = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] barbican.collect_timing        = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] barbican.insecure              = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] barbican.keyfile               = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] barbican.number_of_retries     = 60 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] barbican.retry_delay           = 1 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] barbican.send_service_user_token = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] barbican.split_loggers         = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] barbican.timeout               = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] barbican.verify_ssl            = True {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] barbican.verify_ssl_path       = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] barbican_service_user.auth_section = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] barbican_service_user.auth_type = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] barbican_service_user.cafile   = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] barbican_service_user.certfile = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] barbican_service_user.collect_timing = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] barbican_service_user.insecure = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] barbican_service_user.keyfile  = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] barbican_service_user.split_loggers = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] barbican_service_user.timeout  = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] vault.approle_role_id          = **** {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] vault.approle_secret_id        = **** {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] vault.kv_mountpoint            = secret {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] vault.kv_path                  = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] vault.kv_version               = 2 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] vault.namespace                = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] vault.root_token_id            = **** {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] vault.ssl_ca_crt_file          = None {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] vault.timeout                  = 60.0 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] vault.use_ssl                  = False {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:12 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] ******************************************************************************** {{(pid=83708) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Feb 28 04:40:12 devstack cinder-volume[83826]: DEBUG cinder.volume.drivers.quobyte [None req-9002edb0-1d51-4cb7-898a-20629a746550 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83826) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Feb 28 04:40:12 devstack cinder-volume[83826]: WARNING cinder.volume.drivers.quobyte [None req-9002edb0-1d51-4cb7-898a-20629a746550 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Feb 28 04:40:12 devstack cinder-volume[83826]: WARNING cinder.volume.drivers.quobyte [None req-9002edb0-1d51-4cb7-898a-20629a746550 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Feb 28 04:40:12 devstack cinder-volume[83826]: DEBUG oslo_concurrency.processutils [None req-9002edb0-1d51-4cb7-898a-20629a746550 None None] Running cmd (subprocess): mount.quobyte {{(pid=83826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:40:12 devstack quobyte-client[83827]: Reading configuration file: /etc/quobyte/client.cfg
Feb 28 04:40:12 devstack quobyte-client[83827]: Invalid parameters found, error: missing mount point.
Feb 28 04:40:12 devstack quobyte-client[83827]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Feb 28 04:40:12 devstack quobyte-client[83827]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Feb 28 04:40:12 devstack cinder-volume[83826]: DEBUG oslo_concurrency.processutils [None req-9002edb0-1d51-4cb7-898a-20629a746550 None None] CMD "mount.quobyte" returned: 1 in 0.070s {{(pid=83826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:40:12 devstack cinder-volume[83826]: DEBUG oslo_concurrency.lockutils [None req-9002edb0-1d51-4cb7-898a-20629a746550 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:40:12 devstack cinder-volume[83826]: DEBUG oslo_concurrency.lockutils [None req-9002edb0-1d51-4cb7-898a-20629a746550 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:40:12 devstack cinder-volume[83826]: DEBUG cinder.volume.drivers.quobyte [None req-9002edb0-1d51-4cb7-898a-20629a746550 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=83826) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:40:12 devstack cinder-volume[83826]: INFO cinder.volume.drivers.quobyte [None req-9002edb0-1d51-4cb7-898a-20629a746550 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 ...
Feb 28 04:40:12 devstack cinder-volume[83826]: DEBUG oslo_concurrency.processutils [None req-9002edb0-1d51-4cb7-898a-20629a746550 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc -c /etc/quobyte/client-cinder.cfg {{(pid=83826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:40:12 devstack sudo[83828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc -c /etc/quobyte/client-cinder.cfg
Feb 28 04:40:12 devstack sudo[83828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:40:12 devstack sudo[83828]: pam_unix(sudo:session): session closed for user root
Feb 28 04:40:12 devstack cinder-volume[83826]: DEBUG oslo_concurrency.processutils [None req-9002edb0-1d51-4cb7-898a-20629a746550 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.525s {{(pid=83826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:40:12 devstack cinder-volume[83826]: INFO cinder.volume.drivers.quobyte [None req-9002edb0-1d51-4cb7-898a-20629a746550 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 succeeded
Feb 28 04:40:12 devstack cinder-volume[83826]: DEBUG cinder.volume.drivers.quobyte [None req-9002edb0-1d51-4cb7-898a-20629a746550 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=83826) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:40:12 devstack cinder-volume[83826]: DEBUG oslo_concurrency.lockutils [None req-9002edb0-1d51-4cb7-898a-20629a746550 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.549s {{(pid=83826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:40:12 devstack cinder-volume[83826]: DEBUG oslo_concurrency.processutils [None req-9002edb0-1d51-4cb7-898a-20629a746550 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=83826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:40:12 devstack sudo[83897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:40:12 devstack sudo[83897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:40:13 devstack sudo[83897]: pam_unix(sudo:session): session closed for user root
Feb 28 04:40:13 devstack cinder-volume[83826]: DEBUG oslo_concurrency.processutils [None req-9002edb0-1d51-4cb7-898a-20629a746550 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.447s {{(pid=83826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:40:13 devstack cinder-volume[83826]: INFO cinder.volume.driver [None req-9002edb0-1d51-4cb7-898a-20629a746550 None None] Driver hasn't implemented _init_vendor_properties()
Feb 28 04:40:13 devstack cinder-volume[83826]: DEBUG cinder.volume.driver [None req-9002edb0-1d51-4cb7-898a-20629a746550 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580757141113, 'free_capacity_gb': 1775.7580757141113, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83826) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Feb 28 04:40:13 devstack cinder-volume[83826]: DEBUG oslo_db.sqlalchemy.engines [None req-9002edb0-1d51-4cb7-898a-20629a746550 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83826) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 28 04:40:13 devstack cinder-volume[83826]: DEBUG dbcounter [-] [83826] Writer thread running {{(pid=83826) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Feb 28 04:40:13 devstack cinder-volume[83826]: DEBUG cinder.db.sqlalchemy.api [None req-9002edb0-1d51-4cb7-898a-20629a746550 None None] Building query based on filter {{(pid=83826) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Feb 28 04:40:13 devstack cinder-volume[83826]: DEBUG cinder.image.image_utils [None req-9002edb0-1d51-4cb7-898a-20629a746550 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83826) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Feb 28 04:40:13 devstack cinder-volume[83826]: INFO cinder.keymgr.migration [None req-233c4887-345d-4884-86aa-e38db99c7bd6 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Feb 28 04:40:13 devstack cinder-volume[83826]: DEBUG oslo_concurrency.lockutils [None req-9002edb0-1d51-4cb7-898a-20629a746550 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:40:13 devstack cinder-volume[83826]: DEBUG oslo_concurrency.lockutils [None req-9002edb0-1d51-4cb7-898a-20629a746550 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:40:13 devstack cinder-volume[83826]: DEBUG cinder.volume.drivers.quobyte [None req-9002edb0-1d51-4cb7-898a-20629a746550 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=83826) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:40:13 devstack cinder-volume[83826]: DEBUG cinder.volume.drivers.quobyte [None req-9002edb0-1d51-4cb7-898a-20629a746550 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=83826) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:40:13 devstack cinder-volume[83826]: DEBUG oslo_concurrency.lockutils [None req-9002edb0-1d51-4cb7-898a-20629a746550 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:40:13 devstack cinder-volume[83826]: DEBUG oslo_concurrency.processutils [None req-9002edb0-1d51-4cb7-898a-20629a746550 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=83826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:40:13 devstack sudo[83919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:40:13 devstack sudo[83919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:40:14 devstack sudo[83919]: pam_unix(sudo:session): session closed for user root
Feb 28 04:40:14 devstack cinder-volume[83826]: DEBUG oslo_concurrency.processutils [None req-9002edb0-1d51-4cb7-898a-20629a746550 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.543s {{(pid=83826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:40:14 devstack cinder-volume[83826]: DEBUG cinder.manager [None req-9002edb0-1d51-4cb7-898a-20629a746550 None None] Notifying Schedulers of capabilities ... {{(pid=83826) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:40:14 devstack cinder-volume[83826]: INFO cinder.volume.manager [None req-9002edb0-1d51-4cb7-898a-20629a746550 None None] Driver initialization completed successfully.
Feb 28 04:40:14 devstack cinder-volume[83826]: INFO cinder.manager [None req-9002edb0-1d51-4cb7-898a-20629a746550 None None] Initiating service 3 cleanup
Feb 28 04:40:14 devstack cinder-volume[83826]: INFO cinder.manager [None req-9002edb0-1d51-4cb7-898a-20629a746550 None None] Service 3 cleanup completed.
Feb 28 04:40:14 devstack cinder-volume[83826]: DEBUG cinder.service [None req-9002edb0-1d51-4cb7-898a-20629a746550 None None] Creating RPC server for service cinder-volume {{(pid=83826) start /opt/stack/cinder/cinder/service.py:231}}
Feb 28 04:40:14 devstack cinder-volume[83826]: DEBUG cinder.service [None req-9002edb0-1d51-4cb7-898a-20629a746550 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83826) start /opt/stack/cinder/cinder/service.py:237}}
Feb 28 04:40:14 devstack cinder-volume[83826]: INFO cinder.volume.manager [None req-9002edb0-1d51-4cb7-898a-20629a746550 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Feb 28 04:40:14 devstack cinder-volume[83826]: DEBUG oslo_concurrency.lockutils [None req-9002edb0-1d51-4cb7-898a-20629a746550 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:40:14 devstack cinder-volume[83826]: DEBUG oslo_concurrency.lockutils [None req-9002edb0-1d51-4cb7-898a-20629a746550 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:40:14 devstack cinder-volume[83826]: DEBUG cinder.volume.drivers.quobyte [None req-9002edb0-1d51-4cb7-898a-20629a746550 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=83826) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:40:14 devstack cinder-volume[83826]: DEBUG cinder.volume.drivers.quobyte [None req-9002edb0-1d51-4cb7-898a-20629a746550 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=83826) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:40:14 devstack cinder-volume[83826]: DEBUG oslo_concurrency.lockutils [None req-9002edb0-1d51-4cb7-898a-20629a746550 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:40:14 devstack cinder-volume[83826]: DEBUG oslo_concurrency.processutils [None req-9002edb0-1d51-4cb7-898a-20629a746550 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=83826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:40:14 devstack sudo[83960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:40:14 devstack sudo[83960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:40:14 devstack sudo[83960]: pam_unix(sudo:session): session closed for user root
Feb 28 04:40:14 devstack cinder-volume[83826]: DEBUG oslo_concurrency.processutils [None req-9002edb0-1d51-4cb7-898a-20629a746550 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.483s {{(pid=83826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:40:14 devstack cinder-volume[83826]: INFO cinder.volume.manager [None req-9002edb0-1d51-4cb7-898a-20629a746550 None None] Driver post RPC initialization completed successfully.
Feb 28 04:40:16 devstack cinder-volume[83826]: DEBUG oslo_concurrency.lockutils [None req-34a53405-2381-4b37-bc11-3c1075052435 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:40:16 devstack cinder-volume[83826]: DEBUG oslo_concurrency.lockutils [None req-34a53405-2381-4b37-bc11-3c1075052435 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:40:16 devstack cinder-volume[83826]: DEBUG cinder.volume.drivers.quobyte [None req-34a53405-2381-4b37-bc11-3c1075052435 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=83826) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:40:16 devstack cinder-volume[83826]: DEBUG cinder.volume.drivers.quobyte [None req-34a53405-2381-4b37-bc11-3c1075052435 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=83826) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:40:16 devstack cinder-volume[83826]: DEBUG oslo_concurrency.lockutils [None req-34a53405-2381-4b37-bc11-3c1075052435 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:40:16 devstack cinder-volume[83826]: DEBUG oslo_concurrency.processutils [None req-34a53405-2381-4b37-bc11-3c1075052435 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=83826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:40:16 devstack sudo[84004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:40:16 devstack sudo[84004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:40:16 devstack sudo[84004]: pam_unix(sudo:session): session closed for user root
Feb 28 04:40:16 devstack cinder-volume[83826]: DEBUG oslo_concurrency.processutils [None req-34a53405-2381-4b37-bc11-3c1075052435 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.402s {{(pid=83826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:40:16 devstack cinder-volume[83826]: DEBUG cinder.manager [None req-34a53405-2381-4b37-bc11-3c1075052435 None None] Notifying Schedulers of capabilities ... {{(pid=83826) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:40:17 devstack cinder-volume[83708]: INFO oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] Caught SIGTERM, stopping children
Feb 28 04:40:17 devstack cinder-volume[83708]: DEBUG oslo_concurrency.lockutils [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] Acquiring lock "singleton_lock" {{(pid=83708) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Feb 28 04:40:17 devstack cinder-volume[83708]: DEBUG oslo_concurrency.lockutils [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] Acquired lock "singleton_lock" {{(pid=83708) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Feb 28 04:40:17 devstack cinder-volume[83708]: DEBUG oslo_concurrency.lockutils [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] Releasing lock "singleton_lock" {{(pid=83708) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Feb 28 04:40:17 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] Stop services. {{(pid=83708) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Feb 28 04:40:17 devstack cinder-volume[83708]: DEBUG oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] Killing children. {{(pid=83708) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Feb 28 04:40:17 devstack cinder-volume[83708]: INFO oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] Waiting on 1 children to exit
Feb 28 04:40:22 devstack cinder-volume[83826]: DEBUG oslo_concurrency.lockutils [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] Acquiring lock "singleton_lock" {{(pid=83826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Feb 28 04:40:22 devstack cinder-volume[83826]: DEBUG oslo_concurrency.lockutils [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] Acquired lock "singleton_lock" {{(pid=83826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Feb 28 04:40:22 devstack cinder-volume[83826]: DEBUG oslo_concurrency.lockutils [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] Releasing lock "singleton_lock" {{(pid=83826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Feb 28 04:40:22 devstack cinder-volume[83826]: WARNING amqp [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] Received method (60, 30) during closing channel 1. This method will be ignored
Feb 28 04:40:22 devstack cinder-volume[83826]: WARNING amqp [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] Received method (60, 30) during closing channel 1. This method will be ignored
Feb 28 04:40:22 devstack cinder-volume[83708]: INFO oslo_service.backend._eventlet.service [None req-43559a35-07e4-4b70-ad8e-8fc43c79753c None None] Child 83826 exited with status 0
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=84095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=84095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=84095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Feb 28 04:40:24 devstack cinder-volume[84095]: INFO dbcounter [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] Registered counter for database cinder
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_db.sqlalchemy.engines [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84095) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG dbcounter [-] [84095] Writer thread running {{(pid=84095) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Feb 28 04:40:24 devstack cinder-volume[84095]: INFO cinder.rpc [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Feb 28 04:40:24 devstack cinder-volume[84095]: INFO cinder.rpc [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_db.sqlalchemy.engines [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84095) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 28 04:40:24 devstack cinder-volume[84095]: INFO cinder.volume.manager [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] Determined volume DB was empty at startup.
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG cinder.volume.manager [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=84095) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Feb 28 04:40:24 devstack cinder-volume[84095]: WARNING stevedore.named [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Feb 28 04:40:24 devstack cinder-volume[84095]: WARNING castellan.key_manager [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Feb 28 04:40:24 devstack cinder-volume[84095]: WARNING cinder.keymgr.conf_key_mgr [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Feb 28 04:40:24 devstack cinder-volume[84095]: INFO cinder.volume.manager [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_db.sqlalchemy.engines [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84095) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 28 04:40:24 devstack cinder-volume[84095]: INFO oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] Starting 1 workers
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] Started child 84248 {{(pid=84095) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] Full set of CONF: {{(pid=84095) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] ******************************************************************************** {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] Configuration options gathered from: {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] ================================================================================ {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] allow_availability_zone_fallback = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] allow_compression_on_image_upload = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] allowed_direct_url_schemes     = [] {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:24 devstack cinder-volume[84248]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0)
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] api_rate_limit                 = True {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] auth_strategy                  = keystone {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_availability_zone      = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_host                   = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_name                   = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_stats_polling_interval = 60 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backup_api_class               = cinder.backup.api.API {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backup_name_template           = backup-%s {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backup_use_same_host           = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backup_use_temp_snapshot       = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] chap_password                  = **** {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] chap_username                  =  {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cinder_internal_tenant_project_id = 0af82309d2de49b7bd6a61c7ee44fba2 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cinder_internal_tenant_user_id = 459ea5d57a094c7281b665606101a500 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cluster                        = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] compression_format             = gzip {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] compute_api_class              = cinder.compute.nova.API {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] config_dir                     = [] {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] config_source                  = [] {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] control_exchange               = openstack {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] debug                          = True {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] default_availability_zone      = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] default_group_type             = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] default_volume_type            = QuobyteHD {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] disk_geometry                  = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] driver_client_cert             = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] driver_client_cert_key         = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] driver_data_namespace          = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] driver_ssl_cert_path           = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] driver_ssl_cert_verify         = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] driver_use_ssl                 = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] enable_new_services            = True {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] enable_unsupported_driver      = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] enabled_backends               = ['QuobyteHD'] {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] enforce_multipath_for_image_xfer = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] filter_function                = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] glance_api_insecure            = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:24 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] glance_api_servers             = ['http://192.168.122.41/image'] {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] glance_api_ssl_compression     = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] glance_ca_certificates_file    = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] glance_catalog_info            = image:glance:publicURL {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] glance_certfile                = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] glance_keyfile                 = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] glance_num_retries             = 3 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] glance_request_timeout         = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] goodness_function              = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] graceful_shutdown_timeout      = 5 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] group_api_class                = cinder.group.api.API {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] host                           = devstack {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] image_compress_on_upload       = True {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] image_conversion_address_space_limit = 1 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] image_conversion_cpu_limit     = 60 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] image_conversion_disable       = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] image_upload_use_cinder_backend = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] image_upload_use_internal_tenant = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] image_volume_cache_enabled     = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] image_volume_cache_max_count   = 0 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] image_volume_cache_max_size_gb = 0 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] init_host_max_objects_retrieval = 0 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] instance_format                = [instance: %(uuid)s]  {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] iscsi_target_flags             =  {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] iscsi_write_cache              = on {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] iser_helper                    = tgtadm {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] iser_ip_address                = 192.168.122.41 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] iser_port                      = 3260 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] log_color                      = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] log_config_append              = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] log_dir                        = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] log_file                       = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] log_options                    = True {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] log_rotate_interval            = 1 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] log_rotate_interval_type       = days {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] log_rotation_type              = none {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] max_age                        = 0 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] max_logfile_count              = 30 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] max_logfile_size_mb            = 200 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] max_over_subscription_ratio    = 20.0 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] message_reap_interval          = 86400 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] message_ttl                    = 2592000 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] migration_create_volume_timeout_secs = 300 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] monkey_patch                   = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] monkey_patch_modules           = [] {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] my_ip                          = 192.168.122.41 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] no_snapshot_gb_quota           = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] num_iser_scan_tries            = 3 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] num_shell_tries                = 3 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] num_volume_device_scan_tries   = 3 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] nvmeof_conn_info_version       = 1 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] nvmet_ns_id                    = 10 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] nvmet_port_id                  = 1 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] osapi_max_limit                = 1000 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] osapi_volume_ext_list          = [] {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] osapi_volume_listen_port       = 8776 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] osapi_volume_use_ssl           = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] osapi_volume_workers           = 2 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] per_volume_size_limit          = -1 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] periodic_fuzzy_delay           = 60 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] periodic_interval              = 60 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-0123e842-d4c3-4cfa-bdc3-c89ddc9697fd None None] Starting volume driver QuobyteDriver (1.1.14)
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] public_endpoint                = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] publish_errors                 = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] quota_backup_gigabytes         = 1000 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] quota_backups                  = 10 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] quota_gigabytes                = 1000 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] quota_groups                   = 10 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] quota_snapshots                = 10 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] quota_volumes                  = 10 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] rate_limit_burst               = 0 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] rate_limit_except_level        = CRITICAL {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] rate_limit_interval            = 0 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] reinit_driver_count            = 3 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] replication_device             = **** {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] report_discard_supported       = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-0123e842-d4c3-4cfa-bdc3-c89ddc9697fd None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=84248) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] report_interval                = 120 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] reservation_clean_interval     = 86400 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] reservation_expire             = 86400 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] reserved_image_namespaces      = [] {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] reserved_percentage            = 0 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] rpc_response_timeout           = 120 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] run_external_periodic_tasks    = True {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] scst_target_driver             = iscsi {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] scst_target_iqn_name           = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] service_down_time              = 720 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] shell_completion               = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] snapshot_name_template         = snapshot-%s {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] split_loggers                  = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] state_path                     = /opt/stack/data/cinder {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] storage_availability_zone      = nova {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] storage_protocol               = iSCSI {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] syslog_log_facility            = LOG_USER {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] target_helper                  = lioadm {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] target_ip_address              = 192.168.122.41 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] target_port                    = 3260 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] target_protocol                = iscsi {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] target_secondary_ip_addresses  = [] {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] trace_flags                    = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] transport_url                  = **** {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] until_refresh                  = 0 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] use_chap_auth                  = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] use_default_quota_class        = True {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] use_journal                    = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] use_json                       = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] use_multipath_for_image_xfer   = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] use_stderr                     = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] use_syslog                     = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] verify_glance_signatures       = enabled {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] volume_api_class               = cinder.volume.api.API {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] volume_backend_name            = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] volume_clear                   = zero {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] volume_clear_ionice            = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] volume_clear_size              = 0 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] volume_copy_bps_limit          = 0 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] volume_dd_blocksize            = 1M {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] volume_name_template           = volume-%s {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] volume_service_inithost_offload = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] volume_usage_audit_period      = month {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] zoning_mode                    = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_concurrency.disable_process_locking = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.admin_password = **** {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.admin_token = **** {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.admin_user  = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.auth_port   = 35357 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.auth_protocol = https {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.auth_section = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.auth_type   = password {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.auth_uri    = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.auth_version = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.cache       = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.certfile    = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.delay_auth_decision = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.http_connect_timeout = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.identity_uri = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.include_service_catalog = True {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.insecure    = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.interface   = public {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.keyfile     = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.memcache_password =  {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.memcache_username =  {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.region_name = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.service_token_roles_required = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.service_type = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.token_cache_time = 300 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.41/identity {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cache.backend                  = dogpile.cache.null {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cache.backend_argument         = **** {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cache.backend_expiration_time  = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cache.config_prefix            = cache.oslo {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cache.debug_cache_backend      = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cache.enable_retry_client      = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cache.enable_socket_keepalive  = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cache.enabled                  = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cache.enforce_fips_mode        = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cache.expiration_time          = 600 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cache.hashclient_retry_attempts = 2 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cache.memcache_dead_retry      = 300 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cache.memcache_pool_maxsize    = 10 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cache.memcache_sasl_enabled    = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cache.password                 = **** {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cache.proxies                  = [] {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cache.redis_db                 = 0 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cache.redis_sentinel_service_name = mymaster {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cache.redis_server             = localhost:6379 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cache.retry_attempts           = 2 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cache.retry_delay              = 0.0 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cache.socket_keepalive_count   = 1 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cache.socket_keepalive_idle    = 1 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cache.socket_keepalive_interval = 1 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cache.socket_timeout           = 1.0 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cache.tls_allowed_ciphers      = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cache.tls_cafile               = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cache.tls_certfile             = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cache.tls_enabled              = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cache.tls_keyfile              = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cache.username                 = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] coordination.backend_url       = **** {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] database.asyncio_connection    = **** {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] database.asyncio_slave_connection = **** {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] database.backend               = sqlalchemy {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] database.connection            = **** {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] database.connection_debug      = 0 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] database.connection_parameters =  {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] database.connection_recycle_time = 3600 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] database.connection_trace      = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] database.db_inc_retry_interval = True {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] database.db_max_retries        = 20 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] database.db_max_retry_interval = 10 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] database.db_retry_interval     = 1 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] database.max_overflow          = 50 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] database.max_pool_size         = 5 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] database.max_retries           = 10 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] database.mysql_wsrep_sync_wait = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] database.pool_timeout          = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] database.retry_interval        = 10 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] database.slave_connection      = **** {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] database.sqlite_synchronous    = True {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] database.synchronous_reader    = True {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] database.use_db_reconnect      = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] profiler.connection_string     = messaging:// {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] profiler.enabled               = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] profiler.es_doc_type           = notification {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] profiler.es_scroll_size        = 10000 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] profiler.es_scroll_time        = 2m {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] profiler.filter_error_trace    = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] profiler.hmac_keys             = **** {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] profiler.sentinel_service_name = mymaster {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] profiler.socket_timeout        = 0.1 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] profiler.trace_requests        = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] profiler.trace_sqlalchemy      = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] profiler_jaeger.process_tags   = {} {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] profiler_jaeger.service_name_prefix = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] profiler_otlp.service_name_prefix = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_policy.enforce_new_defaults = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: WARNING oslo_config.cfg [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_policy.enforce_scope      = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_policy.policy_default_rule = default {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_policy.policy_file        = policy.yaml {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] privsep_osbrick.group          = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] privsep_osbrick.helper_command = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] privsep_osbrick.user           = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cinder_sys_admin.group         = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cinder_sys_admin.helper_command = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] cinder_sys_admin.user          = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] service_user.auth_section      = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] service_user.auth_type         = password {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] service_user.cafile            = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] service_user.certfile          = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] service_user.collect_timing    = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] service_user.insecure          = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] service_user.keyfile           = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] service_user.send_service_user_token = True {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] service_user.split_loggers     = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] service_user.timeout           = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] glance.auth_section            = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] glance.auth_type               = password {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] glance.certfile                = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] glance.collect_timing          = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] glance.insecure                = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] glance.keyfile                 = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] glance.region_name             = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] glance.split_loggers           = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] glance.timeout                 = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.backend_availability_zone = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.chap_password = **** {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.chap_username =  {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.disk_geometry = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.driver_client_cert = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-0123e842-d4c3-4cfa-bdc3-c89ddc9697fd None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=84248) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.driver_client_cert_key = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.quobyte [None req-0123e842-d4c3-4cfa-bdc3-c89ddc9697fd None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.driver_data_namespace = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.quobyte [None req-0123e842-d4c3-4cfa-bdc3-c89ddc9697fd None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.driver_use_ssl = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.enable_unsupported_driver = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.extra_capabilities = {} {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.filter_function = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.goodness_function = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-0123e842-d4c3-4cfa-bdc3-c89ddc9697fd None None] Running cmd (subprocess): mount.quobyte {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.iscsi_target_flags =  {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.iscsi_write_cache = on {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.iser_helper   = tgtadm {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.iser_ip_address = 192.168.122.41 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.iser_port     = 3260 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.nas_host      =  {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.nas_login     = admin {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.nas_mount_options = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.nas_password  = **** {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.nas_private_key =  {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.nas_share_path =  {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.num_shell_tries = 3 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.nvmet_port_id = 1 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.quobyte_client_cfg = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.quobyte_volume_url = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.replication_device = **** {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.report_discard_supported = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.reserved_percentage = 0 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.scst_target_driver = iscsi {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.scst_target_iqn_name = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.storage_protocol = iSCSI {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.target_helper = tgtadm {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.target_ip_address = 192.168.122.41 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.target_port   = 3260 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.target_protocol = iscsi {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.trace_flags   = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.unique_fqdn_network = True {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.use_chap_auth = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.volume_backend_name = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.volume_clear  = zero {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.volume_clear_ionice = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.volume_clear_size = 0 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_reports.file_event_handler = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_reports.log_dir           = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.backend_availability_zone = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.backend_host         = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.chap_password        = **** {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.chap_username        = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.chiscsi_conf         = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.disk_geometry        = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.driver_client_cert   = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.driver_client_cert_key = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.driver_data_namespace = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.driver_use_ssl       = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.extra_capabilities   = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.filter_function      = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.goodness_function    = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.iser_helper          = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.iser_ip_address      = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.iser_port            = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.iser_target_prefix   = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.nas_host             = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.nas_login            = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.nas_mount_options    = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.nas_password         = **** {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.nas_private_key      = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.nas_share_path       = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.nas_ssh_port         = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.num_shell_tries      = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.nvmet_port_id        = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.replication_device   = **** {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.report_discard_supported = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.reserved_percentage  = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.scst_target_driver   = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.storage_protocol     = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.target_helper        = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.target_ip_address    = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.target_port          = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.target_prefix        = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.target_protocol      = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.trace_flags          = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.use_chap_auth        = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.volume_clear         = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.volume_clear_size    = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] QuobyteHD.volumes_dir          = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_messaging_rabbit.ssl      = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_messaging_notifications.driver = [] {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_messaging_notifications.retry = -1 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] key_manager.fixed_key          = **** {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] barbican.barbican_api_version  = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] barbican.barbican_endpoint     = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] barbican.barbican_endpoint_type = public {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] barbican.barbican_region_name  = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] barbican.cafile                = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] barbican.certfile              = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] barbican.collect_timing        = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] barbican.insecure              = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] barbican.keyfile               = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] barbican.number_of_retries     = 60 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] barbican.retry_delay           = 1 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] barbican.send_service_user_token = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] barbican.split_loggers         = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] barbican.timeout               = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] barbican.verify_ssl            = True {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] barbican.verify_ssl_path       = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] barbican_service_user.auth_section = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] barbican_service_user.auth_type = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] barbican_service_user.cafile   = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] barbican_service_user.certfile = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] barbican_service_user.collect_timing = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] barbican_service_user.insecure = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] barbican_service_user.keyfile  = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] barbican_service_user.split_loggers = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] barbican_service_user.timeout  = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] vault.approle_role_id          = **** {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] vault.approle_secret_id        = **** {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] vault.kv_mountpoint            = secret {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] vault.kv_path                  = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] vault.kv_version               = 2 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] vault.namespace                = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] vault.root_token_id            = **** {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] vault.ssl_ca_crt_file          = None {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] vault.timeout                  = 60.0 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] vault.use_ssl                  = False {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 04:40:25 devstack cinder-volume[84095]: DEBUG oslo_service.backend._eventlet.service [None req-81d98968-95ab-432f-ba06-d0fa37b2fda0 None None] ******************************************************************************** {{(pid=84095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Feb 28 04:40:25 devstack quobyte-client[84253]: Reading configuration file: /etc/quobyte/client.cfg
Feb 28 04:40:25 devstack quobyte-client[84253]: Invalid parameters found, error: missing mount point.
Feb 28 04:40:25 devstack quobyte-client[84253]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Feb 28 04:40:25 devstack quobyte-client[84253]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Feb 28 04:40:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-0123e842-d4c3-4cfa-bdc3-c89ddc9697fd None None] CMD "mount.quobyte" returned: 1 in 0.072s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:40:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-0123e842-d4c3-4cfa-bdc3-c89ddc9697fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:40:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-0123e842-d4c3-4cfa-bdc3-c89ddc9697fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:40:25 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-0123e842-d4c3-4cfa-bdc3-c89ddc9697fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:40:25 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-0123e842-d4c3-4cfa-bdc3-c89ddc9697fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:40:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-0123e842-d4c3-4cfa-bdc3-c89ddc9697fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:40:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-0123e842-d4c3-4cfa-bdc3-c89ddc9697fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:40:25 devstack sudo[84274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:40:25 devstack sudo[84274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:40:25 devstack sudo[84274]: pam_unix(sudo:session): session closed for user root
Feb 28 04:40:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-0123e842-d4c3-4cfa-bdc3-c89ddc9697fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.400s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:40:25 devstack cinder-volume[84248]: INFO cinder.volume.driver [None req-0123e842-d4c3-4cfa-bdc3-c89ddc9697fd None None] Driver hasn't implemented _init_vendor_properties()
Feb 28 04:40:25 devstack cinder-volume[84248]: DEBUG cinder.volume.driver [None req-0123e842-d4c3-4cfa-bdc3-c89ddc9697fd None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580757141113, 'free_capacity_gb': 1775.7580757141113, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84248) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Feb 28 04:40:25 devstack cinder-volume[84248]: DEBUG oslo_db.sqlalchemy.engines [None req-0123e842-d4c3-4cfa-bdc3-c89ddc9697fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84248) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 28 04:40:25 devstack cinder-volume[84248]: DEBUG dbcounter [-] [84248] Writer thread running {{(pid=84248) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Feb 28 04:40:25 devstack cinder-volume[84248]: DEBUG cinder.db.sqlalchemy.api [None req-0123e842-d4c3-4cfa-bdc3-c89ddc9697fd None None] Building query based on filter {{(pid=84248) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Feb 28 04:40:25 devstack cinder-volume[84248]: DEBUG cinder.image.image_utils [None req-0123e842-d4c3-4cfa-bdc3-c89ddc9697fd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=84248) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Feb 28 04:40:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-0123e842-d4c3-4cfa-bdc3-c89ddc9697fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:40:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-0123e842-d4c3-4cfa-bdc3-c89ddc9697fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:40:25 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-0123e842-d4c3-4cfa-bdc3-c89ddc9697fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:40:25 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-0123e842-d4c3-4cfa-bdc3-c89ddc9697fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:40:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-0123e842-d4c3-4cfa-bdc3-c89ddc9697fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:40:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-0123e842-d4c3-4cfa-bdc3-c89ddc9697fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:40:25 devstack cinder-volume[84248]: INFO cinder.keymgr.migration [None req-78e658bc-ee7c-44db-93ae-2116810b8a2c None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Feb 28 04:40:25 devstack sudo[84313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:40:25 devstack sudo[84313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:40:26 devstack sudo[84313]: pam_unix(sudo:session): session closed for user root
Feb 28 04:40:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-0123e842-d4c3-4cfa-bdc3-c89ddc9697fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.443s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:40:26 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-0123e842-d4c3-4cfa-bdc3-c89ddc9697fd None None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:40:26 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-0123e842-d4c3-4cfa-bdc3-c89ddc9697fd None None] Driver initialization completed successfully.
Feb 28 04:40:26 devstack cinder-volume[84248]: INFO cinder.manager [None req-0123e842-d4c3-4cfa-bdc3-c89ddc9697fd None None] Initiating service 3 cleanup
Feb 28 04:40:26 devstack cinder-volume[84248]: INFO cinder.manager [None req-0123e842-d4c3-4cfa-bdc3-c89ddc9697fd None None] Service 3 cleanup completed.
Feb 28 04:40:26 devstack cinder-volume[84248]: DEBUG cinder.service [None req-0123e842-d4c3-4cfa-bdc3-c89ddc9697fd None None] Creating RPC server for service cinder-volume {{(pid=84248) start /opt/stack/cinder/cinder/service.py:231}}
Feb 28 04:40:26 devstack cinder-volume[84248]: DEBUG cinder.service [None req-0123e842-d4c3-4cfa-bdc3-c89ddc9697fd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=84248) start /opt/stack/cinder/cinder/service.py:237}}
Feb 28 04:40:26 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-0123e842-d4c3-4cfa-bdc3-c89ddc9697fd None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Feb 28 04:40:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-0123e842-d4c3-4cfa-bdc3-c89ddc9697fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:40:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-0123e842-d4c3-4cfa-bdc3-c89ddc9697fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:40:26 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-0123e842-d4c3-4cfa-bdc3-c89ddc9697fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:40:26 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-0123e842-d4c3-4cfa-bdc3-c89ddc9697fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:40:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-0123e842-d4c3-4cfa-bdc3-c89ddc9697fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:40:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-0123e842-d4c3-4cfa-bdc3-c89ddc9697fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:40:26 devstack sudo[84339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:40:26 devstack sudo[84339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:40:26 devstack sudo[84339]: pam_unix(sudo:session): session closed for user root
Feb 28 04:40:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-0123e842-d4c3-4cfa-bdc3-c89ddc9697fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.372s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:40:26 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-0123e842-d4c3-4cfa-bdc3-c89ddc9697fd None None] Driver post RPC initialization completed successfully.
Feb 28 04:40:34 devstack cinder-volume[84095]: DEBUG dbcounter [-] [84095] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=84095) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 04:40:36 devstack cinder-volume[84248]: DEBUG dbcounter [-] [84248] Writing DB stats cinder:SELECT=3 {{(pid=84248) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 04:40:36 devstack cinder-volume[84248]: DEBUG dbcounter [-] [84248] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=84248) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 04:41:30 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-59e5bfdd-77f7-4843-8605-c94cfa3d10cd tempest-VolumesAdminNegativeTest-1164200725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:41:30 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-59e5bfdd-77f7-4843-8605-c94cfa3d10cd tempest-VolumesAdminNegativeTest-1164200725 None] Flow 'volume_create_manager' (ea59a7c7-3d35-4752-aab9-da610bd942cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:41:30 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-59e5bfdd-77f7-4843-8605-c94cfa3d10cd tempest-VolumesAdminNegativeTest-1164200725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e3695ae-456f-40e9-8b3a-4b8c15e01597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:41:31 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-59e5bfdd-77f7-4843-8605-c94cfa3d10cd tempest-VolumesAdminNegativeTest-1164200725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e3695ae-456f-40e9-8b3a-4b8c15e01597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1876146834',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=545ac0dc-0972-4624-804e-7f2719ad664f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eb53ee7049642a8b0b070f8b96ff0d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:41:31Z,use_quota=True,user_id='7103e46a4a65493686b2bc12ff105e9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:41:31 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-59e5bfdd-77f7-4843-8605-c94cfa3d10cd tempest-VolumesAdminNegativeTest-1164200725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (574eb7b1-37ec-479d-911a-70eb9a270555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:41:31 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-59e5bfdd-77f7-4843-8605-c94cfa3d10cd tempest-VolumesAdminNegativeTest-1164200725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (574eb7b1-37ec-479d-911a-70eb9a270555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:41:31 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-59e5bfdd-77f7-4843-8605-c94cfa3d10cd tempest-VolumesAdminNegativeTest-1164200725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (934aefef-98b7-4b13-a9c6-639fee001925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:41:31 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-59e5bfdd-77f7-4843-8605-c94cfa3d10cd tempest-VolumesAdminNegativeTest-1164200725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (934aefef-98b7-4b13-a9c6-639fee001925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '545ac0dc-0972-4624-804e-7f2719ad664f', 'volume_name': 'volume-545ac0dc-0972-4624-804e-7f2719ad664f', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:41:31 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-59e5bfdd-77f7-4843-8605-c94cfa3d10cd tempest-VolumesAdminNegativeTest-1164200725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f965552-9db1-4beb-bb68-8687a8eaa2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:41:31 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-59e5bfdd-77f7-4843-8605-c94cfa3d10cd tempest-VolumesAdminNegativeTest-1164200725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f965552-9db1-4beb-bb68-8687a8eaa2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:41:31 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-59e5bfdd-77f7-4843-8605-c94cfa3d10cd tempest-VolumesAdminNegativeTest-1164200725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c917bba-d319-4f43-8cef-ef89c68ffa63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:41:31 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-59e5bfdd-77f7-4843-8605-c94cfa3d10cd tempest-VolumesAdminNegativeTest-1164200725 None] Volume 545ac0dc-0972-4624-804e-7f2719ad664f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-545ac0dc-0972-4624-804e-7f2719ad664f', 'volume_size': 1}
Feb 28 04:41:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-59e5bfdd-77f7-4843-8605-c94cfa3d10cd tempest-VolumesAdminNegativeTest-1164200725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:41:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-59e5bfdd-77f7-4843-8605-c94cfa3d10cd tempest-VolumesAdminNegativeTest-1164200725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:41:31 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-59e5bfdd-77f7-4843-8605-c94cfa3d10cd tempest-VolumesAdminNegativeTest-1164200725 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1876146834',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=545ac0dc-0972-4624-804e-7f2719ad664f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eb53ee7049642a8b0b070f8b96ff0d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:41:31Z,use_quota=True,user_id='7103e46a4a65493686b2bc12ff105e9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:41:31 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-59e5bfdd-77f7-4843-8605-c94cfa3d10cd tempest-VolumesAdminNegativeTest-1164200725 None] Creating volume 545ac0dc-0972-4624-804e-7f2719ad664f {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:41:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-59e5bfdd-77f7-4843-8605-c94cfa3d10cd tempest-VolumesAdminNegativeTest-1164200725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:41:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-59e5bfdd-77f7-4843-8605-c94cfa3d10cd tempest-VolumesAdminNegativeTest-1164200725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:41:31 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-59e5bfdd-77f7-4843-8605-c94cfa3d10cd tempest-VolumesAdminNegativeTest-1164200725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:41:31 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-59e5bfdd-77f7-4843-8605-c94cfa3d10cd tempest-VolumesAdminNegativeTest-1164200725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:41:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-59e5bfdd-77f7-4843-8605-c94cfa3d10cd tempest-VolumesAdminNegativeTest-1164200725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:41:31 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-59e5bfdd-77f7-4843-8605-c94cfa3d10cd tempest-VolumesAdminNegativeTest-1164200725 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:41:31 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-59e5bfdd-77f7-4843-8605-c94cfa3d10cd tempest-VolumesAdminNegativeTest-1164200725 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:41:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-59e5bfdd-77f7-4843-8605-c94cfa3d10cd tempest-VolumesAdminNegativeTest-1164200725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-545ac0dc-0972-4624-804e-7f2719ad664f 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:41:31 devstack sudo[84782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-545ac0dc-0972-4624-804e-7f2719ad664f 1073741824
Feb 28 04:41:31 devstack sudo[84782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:41:32 devstack sudo[84782]: pam_unix(sudo:session): session closed for user root
Feb 28 04:41:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-59e5bfdd-77f7-4843-8605-c94cfa3d10cd tempest-VolumesAdminNegativeTest-1164200725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-545ac0dc-0972-4624-804e-7f2719ad664f 1073741824" returned: 0 in 1.566s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:41:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-59e5bfdd-77f7-4843-8605-c94cfa3d10cd tempest-VolumesAdminNegativeTest-1164200725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-545ac0dc-0972-4624-804e-7f2719ad664f {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:41:32 devstack sudo[85104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-545ac0dc-0972-4624-804e-7f2719ad664f
Feb 28 04:41:32 devstack sudo[85104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:41:33 devstack sudo[85104]: pam_unix(sudo:session): session closed for user root
Feb 28 04:41:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-59e5bfdd-77f7-4843-8605-c94cfa3d10cd tempest-VolumesAdminNegativeTest-1164200725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-545ac0dc-0972-4624-804e-7f2719ad664f" returned: 0 in 0.622s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:41:33 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-59e5bfdd-77f7-4843-8605-c94cfa3d10cd tempest-VolumesAdminNegativeTest-1164200725 None] <== create_volume: return (2242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:41:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-59e5bfdd-77f7-4843-8605-c94cfa3d10cd tempest-VolumesAdminNegativeTest-1164200725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.244s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:41:33 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-59e5bfdd-77f7-4843-8605-c94cfa3d10cd tempest-VolumesAdminNegativeTest-1164200725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c917bba-d319-4f43-8cef-ef89c68ffa63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-545ac0dc-0972-4624-804e-7f2719ad664f', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:41:33 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-59e5bfdd-77f7-4843-8605-c94cfa3d10cd tempest-VolumesAdminNegativeTest-1164200725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2677f202-953d-46fd-adef-9c938e5b2aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:41:33 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-59e5bfdd-77f7-4843-8605-c94cfa3d10cd tempest-VolumesAdminNegativeTest-1164200725 None] Volume volume-545ac0dc-0972-4624-804e-7f2719ad664f (545ac0dc-0972-4624-804e-7f2719ad664f): created successfully
Feb 28 04:41:33 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-59e5bfdd-77f7-4843-8605-c94cfa3d10cd tempest-VolumesAdminNegativeTest-1164200725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2677f202-953d-46fd-adef-9c938e5b2aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:41:33 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-59e5bfdd-77f7-4843-8605-c94cfa3d10cd tempest-VolumesAdminNegativeTest-1164200725 None] Flow 'volume_create_manager' (ea59a7c7-3d35-4752-aab9-da610bd942cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:41:33 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-59e5bfdd-77f7-4843-8605-c94cfa3d10cd tempest-VolumesAdminNegativeTest-1164200725 None] Created volume successfully.
Feb 28 04:41:34 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-bc468323-b3ee-4057-8cc3-1232348cbcaf tempest-VolumesAdminNegativeTest-1164200725 None] Acquiring lock "cinder-545ac0dc-0972-4624-804e-7f2719ad664f-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:41:34 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-bc468323-b3ee-4057-8cc3-1232348cbcaf tempest-VolumesAdminNegativeTest-1164200725 None] Lock "cinder-545ac0dc-0972-4624-804e-7f2719ad664f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:41:34 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-bc468323-b3ee-4057-8cc3-1232348cbcaf tempest-VolumesAdminNegativeTest-1164200725 None] Acquiring lock "cinder-quobyte-545ac0dc-0972-4624-804e-7f2719ad664f" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:41:34 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-bc468323-b3ee-4057-8cc3-1232348cbcaf tempest-VolumesAdminNegativeTest-1164200725 None] Lock "cinder-quobyte-545ac0dc-0972-4624-804e-7f2719ad664f" acquired by "delete_volume" :: waited 0.009s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:41:34 devstack cinder-volume[84248]: INFO oslo.privsep.daemon [None req-bc468323-b3ee-4057-8cc3-1232348cbcaf tempest-VolumesAdminNegativeTest-1164200725 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpd_ha25eo/privsep.sock']
Feb 28 04:41:34 devstack sudo[85109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpd_ha25eo/privsep.sock
Feb 28 04:41:34 devstack sudo[85109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:41:37 devstack sudo[85109]: pam_unix(sudo:session): session closed for user root
Feb 28 04:41:37 devstack cinder-volume[84248]: INFO oslo.privsep.daemon [None req-bc468323-b3ee-4057-8cc3-1232348cbcaf tempest-VolumesAdminNegativeTest-1164200725 None] Spawned new privsep daemon via rootwrap
Feb 28 04:41:37 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [None req-bc468323-b3ee-4057-8cc3-1232348cbcaf tempest-VolumesAdminNegativeTest-1164200725 None] Accepted privsep connection to /tmp/tmpd_ha25eo/privsep.sock {{(pid=84248) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}}
Feb 28 04:41:37 devstack cinder-volume[84248]: INFO oslo.privsep.daemon [-] privsep daemon starting
Feb 28 04:41:37 devstack cinder-volume[84248]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Feb 28 04:41:37 devstack cinder-volume[84248]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Feb 28 04:41:37 devstack cinder-volume[84248]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85115
Feb 28 04:41:37 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c5f2e8-47ab-4bad-b54f-79070efc85cd]: (2,) {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:41:37 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc17b5c1-d469-4671-aed4-fd9229fa0c08]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:41:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-bc468323-b3ee-4057-8cc3-1232348cbcaf tempest-VolumesAdminNegativeTest-1164200725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-545ac0dc-0972-4624-804e-7f2719ad664f {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:41:37 devstack sudo[85118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-545ac0dc-0972-4624-804e-7f2719ad664f
Feb 28 04:41:37 devstack sudo[85118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:41:38 devstack sudo[85118]: pam_unix(sudo:session): session closed for user root
Feb 28 04:41:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-bc468323-b3ee-4057-8cc3-1232348cbcaf tempest-VolumesAdminNegativeTest-1164200725 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-545ac0dc-0972-4624-804e-7f2719ad664f" returned: 0 in 1.016s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:41:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-bc468323-b3ee-4057-8cc3-1232348cbcaf tempest-VolumesAdminNegativeTest-1164200725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-545ac0dc-0972-4624-804e-7f2719ad664f {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:41:38 devstack sudo[85123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-545ac0dc-0972-4624-804e-7f2719ad664f
Feb 28 04:41:38 devstack sudo[85123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:41:39 devstack sudo[85123]: pam_unix(sudo:session): session closed for user root
Feb 28 04:41:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-bc468323-b3ee-4057-8cc3-1232348cbcaf tempest-VolumesAdminNegativeTest-1164200725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-545ac0dc-0972-4624-804e-7f2719ad664f" returned: 0 in 1.061s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:41:39 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-bc468323-b3ee-4057-8cc3-1232348cbcaf tempest-VolumesAdminNegativeTest-1164200725 None] Lock "cinder-quobyte-545ac0dc-0972-4624-804e-7f2719ad664f" released by "delete_volume" :: held 4.557s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:41:39 devstack cinder-volume[84248]: WARNING cinder.quota [None req-bc468323-b3ee-4057-8cc3-1232348cbcaf tempest-VolumesAdminNegativeTest-1164200725 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Feb 28 04:41:39 devstack cinder-volume[84248]: WARNING cinder.quota [None req-bc468323-b3ee-4057-8cc3-1232348cbcaf tempest-VolumesAdminNegativeTest-1164200725 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Feb 28 04:41:39 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-bc468323-b3ee-4057-8cc3-1232348cbcaf tempest-VolumesAdminNegativeTest-1164200725 None] Created reservations ['65e08f2e-33f4-481f-a97d-d369d630660d', 'a321c2b1-4dd6-4569-b9f3-8cf81811bce7', '26224666-eec5-4980-a8d2-2be169cb962e', 'a6f779ea-4026-4f1a-b8df-510dac10fc70'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:41:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-bc468323-b3ee-4057-8cc3-1232348cbcaf tempest-VolumesAdminNegativeTest-1164200725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:41:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-bc468323-b3ee-4057-8cc3-1232348cbcaf tempest-VolumesAdminNegativeTest-1164200725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:41:39 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-bc468323-b3ee-4057-8cc3-1232348cbcaf tempest-VolumesAdminNegativeTest-1164200725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:41:39 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-bc468323-b3ee-4057-8cc3-1232348cbcaf tempest-VolumesAdminNegativeTest-1164200725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:41:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-bc468323-b3ee-4057-8cc3-1232348cbcaf tempest-VolumesAdminNegativeTest-1164200725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:41:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-bc468323-b3ee-4057-8cc3-1232348cbcaf tempest-VolumesAdminNegativeTest-1164200725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:41:39 devstack sudo[85127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:41:39 devstack sudo[85127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:41:40 devstack sudo[85127]: pam_unix(sudo:session): session closed for user root
Feb 28 04:41:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-bc468323-b3ee-4057-8cc3-1232348cbcaf tempest-VolumesAdminNegativeTest-1164200725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.584s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:41:40 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-bc468323-b3ee-4057-8cc3-1232348cbcaf tempest-VolumesAdminNegativeTest-1164200725 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:41:40 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-bc468323-b3ee-4057-8cc3-1232348cbcaf tempest-VolumesAdminNegativeTest-1164200725 None] Deleted volume successfully.
Feb 28 04:41:40 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-bc468323-b3ee-4057-8cc3-1232348cbcaf tempest-VolumesAdminNegativeTest-1164200725 None] Lock "cinder-545ac0dc-0972-4624-804e-7f2719ad664f-delete_volume" released by "delete_volume" :: held 5.560s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:41:44 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [req-b872b145-51d9-4e99-a764-9f783a72bafc req-4bbbc3ae-6683-4c6f-853c-7b0cb915d173 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:41:44 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-b872b145-51d9-4e99-a764-9f783a72bafc req-4bbbc3ae-6683-4c6f-853c-7b0cb915d173 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Flow 'volume_create_manager' (afe5ffc7-6dff-4fa3-bd8c-845ea6556d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:41:44 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-b872b145-51d9-4e99-a764-9f783a72bafc req-4bbbc3ae-6683-4c6f-853c-7b0cb915d173 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bccf3d27-66dd-48c3-a96d-8a376dc51059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:41:44 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-b872b145-51d9-4e99-a764-9f783a72bafc req-4bbbc3ae-6683-4c6f-853c-7b0cb915d173 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bccf3d27-66dd-48c3-a96d-8a376dc51059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:41:44Z,deleted=False,deleted_at=None,display_description='',display_name='bc3f862a-b872-4283-b243-0cfef5228126-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf5fc4a3-ac9c-4cf6-949b-4e1fd2a8e7fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca2eb5fbb88b4897bd842d0e6d327320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:41:45Z,use_quota=True,user_id='62168aa8c3fd406f8acc081b76e769a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:41:44 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-b872b145-51d9-4e99-a764-9f783a72bafc req-4bbbc3ae-6683-4c6f-853c-7b0cb915d173 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f44a8ea6-ba0d-4b29-b326-462058293e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:41:44 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-b872b145-51d9-4e99-a764-9f783a72bafc req-4bbbc3ae-6683-4c6f-853c-7b0cb915d173 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f44a8ea6-ba0d-4b29-b326-462058293e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:41:44 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-b872b145-51d9-4e99-a764-9f783a72bafc req-4bbbc3ae-6683-4c6f-853c-7b0cb915d173 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aad9e3e-6190-4207-9bde-9a26b971c6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:41:44 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-b872b145-51d9-4e99-a764-9f783a72bafc req-4bbbc3ae-6683-4c6f-853c-7b0cb915d173 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aad9e3e-6190-4207-9bde-9a26b971c6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf5fc4a3-ac9c-4cf6-949b-4e1fd2a8e7fa', 'volume_name': 'volume-bf5fc4a3-ac9c-4cf6-949b-4e1fd2a8e7fa', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:41:44 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-b872b145-51d9-4e99-a764-9f783a72bafc req-4bbbc3ae-6683-4c6f-853c-7b0cb915d173 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4185a772-9405-421c-8548-627634316193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:41:44 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-b872b145-51d9-4e99-a764-9f783a72bafc req-4bbbc3ae-6683-4c6f-853c-7b0cb915d173 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4185a772-9405-421c-8548-627634316193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:41:44 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-b872b145-51d9-4e99-a764-9f783a72bafc req-4bbbc3ae-6683-4c6f-853c-7b0cb915d173 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5cc2493-1a1e-450b-b8e8-fbde43cb0d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:41:44 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [req-b872b145-51d9-4e99-a764-9f783a72bafc req-4bbbc3ae-6683-4c6f-853c-7b0cb915d173 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Volume bf5fc4a3-ac9c-4cf6-949b-4e1fd2a8e7fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf5fc4a3-ac9c-4cf6-949b-4e1fd2a8e7fa', 'volume_size': 1}
Feb 28 04:41:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-b872b145-51d9-4e99-a764-9f783a72bafc req-4bbbc3ae-6683-4c6f-853c-7b0cb915d173 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:41:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-b872b145-51d9-4e99-a764-9f783a72bafc req-4bbbc3ae-6683-4c6f-853c-7b0cb915d173 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:41:44 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [req-b872b145-51d9-4e99-a764-9f783a72bafc req-4bbbc3ae-6683-4c6f-853c-7b0cb915d173 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:41:44Z,deleted=False,deleted_at=None,display_description='',display_name='bc3f862a-b872-4283-b243-0cfef5228126-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf5fc4a3-ac9c-4cf6-949b-4e1fd2a8e7fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca2eb5fbb88b4897bd842d0e6d327320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:41:45Z,use_quota=True,user_id='62168aa8c3fd406f8acc081b76e769a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:41:44 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [req-b872b145-51d9-4e99-a764-9f783a72bafc req-4bbbc3ae-6683-4c6f-853c-7b0cb915d173 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Creating volume bf5fc4a3-ac9c-4cf6-949b-4e1fd2a8e7fa {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:41:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-b872b145-51d9-4e99-a764-9f783a72bafc req-4bbbc3ae-6683-4c6f-853c-7b0cb915d173 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:41:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-b872b145-51d9-4e99-a764-9f783a72bafc req-4bbbc3ae-6683-4c6f-853c-7b0cb915d173 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:41:44 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [req-b872b145-51d9-4e99-a764-9f783a72bafc req-4bbbc3ae-6683-4c6f-853c-7b0cb915d173 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:41:44 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [req-b872b145-51d9-4e99-a764-9f783a72bafc req-4bbbc3ae-6683-4c6f-853c-7b0cb915d173 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:41:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-b872b145-51d9-4e99-a764-9f783a72bafc req-4bbbc3ae-6683-4c6f-853c-7b0cb915d173 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:41:44 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [req-b872b145-51d9-4e99-a764-9f783a72bafc req-4bbbc3ae-6683-4c6f-853c-7b0cb915d173 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:41:44 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [req-b872b145-51d9-4e99-a764-9f783a72bafc req-4bbbc3ae-6683-4c6f-853c-7b0cb915d173 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:41:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-b872b145-51d9-4e99-a764-9f783a72bafc req-4bbbc3ae-6683-4c6f-853c-7b0cb915d173 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bf5fc4a3-ac9c-4cf6-949b-4e1fd2a8e7fa 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:41:44 devstack sudo[85206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bf5fc4a3-ac9c-4cf6-949b-4e1fd2a8e7fa 1073741824
Feb 28 04:41:44 devstack sudo[85206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:41:46 devstack sudo[85206]: pam_unix(sudo:session): session closed for user root
Feb 28 04:41:46 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-b872b145-51d9-4e99-a764-9f783a72bafc req-4bbbc3ae-6683-4c6f-853c-7b0cb915d173 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bf5fc4a3-ac9c-4cf6-949b-4e1fd2a8e7fa 1073741824" returned: 0 in 1.677s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:41:46 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-b872b145-51d9-4e99-a764-9f783a72bafc req-4bbbc3ae-6683-4c6f-853c-7b0cb915d173 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bf5fc4a3-ac9c-4cf6-949b-4e1fd2a8e7fa {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:41:46 devstack sudo[85233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bf5fc4a3-ac9c-4cf6-949b-4e1fd2a8e7fa
Feb 28 04:41:46 devstack sudo[85233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:41:47 devstack sudo[85233]: pam_unix(sudo:session): session closed for user root
Feb 28 04:41:47 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-b872b145-51d9-4e99-a764-9f783a72bafc req-4bbbc3ae-6683-4c6f-853c-7b0cb915d173 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bf5fc4a3-ac9c-4cf6-949b-4e1fd2a8e7fa" returned: 0 in 0.865s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:41:47 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [req-b872b145-51d9-4e99-a764-9f783a72bafc req-4bbbc3ae-6683-4c6f-853c-7b0cb915d173 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] <== create_volume: return (2627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:41:47 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-b872b145-51d9-4e99-a764-9f783a72bafc req-4bbbc3ae-6683-4c6f-853c-7b0cb915d173 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.643s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:41:47 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-b872b145-51d9-4e99-a764-9f783a72bafc req-4bbbc3ae-6683-4c6f-853c-7b0cb915d173 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5cc2493-1a1e-450b-b8e8-fbde43cb0d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf5fc4a3-ac9c-4cf6-949b-4e1fd2a8e7fa', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:41:47 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-b872b145-51d9-4e99-a764-9f783a72bafc req-4bbbc3ae-6683-4c6f-853c-7b0cb915d173 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (384f9460-845f-4ce8-946e-f68eb7dd55a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:41:47 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [req-b872b145-51d9-4e99-a764-9f783a72bafc req-4bbbc3ae-6683-4c6f-853c-7b0cb915d173 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Volume volume-bf5fc4a3-ac9c-4cf6-949b-4e1fd2a8e7fa (bf5fc4a3-ac9c-4cf6-949b-4e1fd2a8e7fa): created successfully
Feb 28 04:41:47 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-b872b145-51d9-4e99-a764-9f783a72bafc req-4bbbc3ae-6683-4c6f-853c-7b0cb915d173 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (384f9460-845f-4ce8-946e-f68eb7dd55a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:41:47 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-b872b145-51d9-4e99-a764-9f783a72bafc req-4bbbc3ae-6683-4c6f-853c-7b0cb915d173 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Flow 'volume_create_manager' (afe5ffc7-6dff-4fa3-bd8c-845ea6556d31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:41:47 devstack cinder-volume[84248]: INFO cinder.volume.manager [req-b872b145-51d9-4e99-a764-9f783a72bafc req-4bbbc3ae-6683-4c6f-853c-7b0cb915d173 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Created volume successfully.
Feb 28 04:41:50 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-72fa60e7-5084-475c-bd00-b2d3b4e2d37d tempest-ServerRescueNegativeTestJSON-435163099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:41:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-72fa60e7-5084-475c-bd00-b2d3b4e2d37d tempest-ServerRescueNegativeTestJSON-435163099 None] Flow 'volume_create_manager' (20610123-d572-409a-8bc7-c2820f86fd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:41:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-72fa60e7-5084-475c-bd00-b2d3b4e2d37d tempest-ServerRescueNegativeTestJSON-435163099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e384cc97-b1ca-485c-a750-e9bc24f6555e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:41:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-72fa60e7-5084-475c-bd00-b2d3b4e2d37d tempest-ServerRescueNegativeTestJSON-435163099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e384cc97-b1ca-485c-a750-e9bc24f6555e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-580827507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3083bde6-d495-43ef-9e92-a69d46d5416c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='913a7296110f49d19738cbb01178e24b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:41:51Z,use_quota=True,user_id='8813d4ad00d1434b839917f2b8a7b62c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:41:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-72fa60e7-5084-475c-bd00-b2d3b4e2d37d tempest-ServerRescueNegativeTestJSON-435163099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1648973a-e61a-4d7d-b5b2-d09d4bcf2bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:41:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-72fa60e7-5084-475c-bd00-b2d3b4e2d37d tempest-ServerRescueNegativeTestJSON-435163099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1648973a-e61a-4d7d-b5b2-d09d4bcf2bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:41:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-72fa60e7-5084-475c-bd00-b2d3b4e2d37d tempest-ServerRescueNegativeTestJSON-435163099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9ac6cc5-9eff-4db6-bb5a-6fb34120b2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:41:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-72fa60e7-5084-475c-bd00-b2d3b4e2d37d tempest-ServerRescueNegativeTestJSON-435163099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9ac6cc5-9eff-4db6-bb5a-6fb34120b2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3083bde6-d495-43ef-9e92-a69d46d5416c', 'volume_name': 'volume-3083bde6-d495-43ef-9e92-a69d46d5416c', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:41:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-72fa60e7-5084-475c-bd00-b2d3b4e2d37d tempest-ServerRescueNegativeTestJSON-435163099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dd5246a-4863-46c4-acc5-7911b4f148b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:41:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-72fa60e7-5084-475c-bd00-b2d3b4e2d37d tempest-ServerRescueNegativeTestJSON-435163099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dd5246a-4863-46c4-acc5-7911b4f148b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:41:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-72fa60e7-5084-475c-bd00-b2d3b4e2d37d tempest-ServerRescueNegativeTestJSON-435163099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf3f33fe-a8b1-4340-818b-bc7b4f3dcb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:41:51 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-72fa60e7-5084-475c-bd00-b2d3b4e2d37d tempest-ServerRescueNegativeTestJSON-435163099 None] Volume 3083bde6-d495-43ef-9e92-a69d46d5416c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3083bde6-d495-43ef-9e92-a69d46d5416c', 'volume_size': 1}
Feb 28 04:41:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-72fa60e7-5084-475c-bd00-b2d3b4e2d37d tempest-ServerRescueNegativeTestJSON-435163099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:41:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-72fa60e7-5084-475c-bd00-b2d3b4e2d37d tempest-ServerRescueNegativeTestJSON-435163099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:41:51 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-72fa60e7-5084-475c-bd00-b2d3b4e2d37d tempest-ServerRescueNegativeTestJSON-435163099 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-580827507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3083bde6-d495-43ef-9e92-a69d46d5416c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='913a7296110f49d19738cbb01178e24b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:41:51Z,use_quota=True,user_id='8813d4ad00d1434b839917f2b8a7b62c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:41:51 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-72fa60e7-5084-475c-bd00-b2d3b4e2d37d tempest-ServerRescueNegativeTestJSON-435163099 None] Creating volume 3083bde6-d495-43ef-9e92-a69d46d5416c {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:41:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-72fa60e7-5084-475c-bd00-b2d3b4e2d37d tempest-ServerRescueNegativeTestJSON-435163099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:41:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-72fa60e7-5084-475c-bd00-b2d3b4e2d37d tempest-ServerRescueNegativeTestJSON-435163099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:41:51 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-72fa60e7-5084-475c-bd00-b2d3b4e2d37d tempest-ServerRescueNegativeTestJSON-435163099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:41:51 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-72fa60e7-5084-475c-bd00-b2d3b4e2d37d tempest-ServerRescueNegativeTestJSON-435163099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:41:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-72fa60e7-5084-475c-bd00-b2d3b4e2d37d tempest-ServerRescueNegativeTestJSON-435163099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:41:51 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-72fa60e7-5084-475c-bd00-b2d3b4e2d37d tempest-ServerRescueNegativeTestJSON-435163099 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:41:51 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-72fa60e7-5084-475c-bd00-b2d3b4e2d37d tempest-ServerRescueNegativeTestJSON-435163099 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:41:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-72fa60e7-5084-475c-bd00-b2d3b4e2d37d tempest-ServerRescueNegativeTestJSON-435163099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3083bde6-d495-43ef-9e92-a69d46d5416c 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:41:51 devstack sudo[85289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3083bde6-d495-43ef-9e92-a69d46d5416c 1073741824
Feb 28 04:41:51 devstack sudo[85289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:41:51 devstack cinder-volume[84248]: WARNING py.warnings [req-b872b145-51d9-4e99-a764-9f783a72bafc req-91e65053-88d3-4ed3-a470-ff7fae1289f4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment".  Apply join condition(s) between each element to resolve.
Feb 28 04:41:51 devstack cinder-volume[84248]:   .first()
Feb 28 04:41:51 devstack cinder-volume[84248]: 
Feb 28 04:41:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-b872b145-51d9-4e99-a764-9f783a72bafc req-91e65053-88d3-4ed3-a470-ff7fae1289f4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:41:52 devstack sudo[85289]: pam_unix(sudo:session): session closed for user root
Feb 28 04:41:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-72fa60e7-5084-475c-bd00-b2d3b4e2d37d tempest-ServerRescueNegativeTestJSON-435163099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3083bde6-d495-43ef-9e92-a69d46d5416c 1073741824" returned: 0 in 1.665s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:41:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-72fa60e7-5084-475c-bd00-b2d3b4e2d37d tempest-ServerRescueNegativeTestJSON-435163099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3083bde6-d495-43ef-9e92-a69d46d5416c {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:41:52 devstack sudo[85315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3083bde6-d495-43ef-9e92-a69d46d5416c
Feb 28 04:41:52 devstack sudo[85315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:41:53 devstack sudo[85315]: pam_unix(sudo:session): session closed for user root
Feb 28 04:41:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-72fa60e7-5084-475c-bd00-b2d3b4e2d37d tempest-ServerRescueNegativeTestJSON-435163099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3083bde6-d495-43ef-9e92-a69d46d5416c" returned: 0 in 0.669s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:41:53 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-72fa60e7-5084-475c-bd00-b2d3b4e2d37d tempest-ServerRescueNegativeTestJSON-435163099 None] <== create_volume: return (2441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:41:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-72fa60e7-5084-475c-bd00-b2d3b4e2d37d tempest-ServerRescueNegativeTestJSON-435163099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.445s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:41:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-b872b145-51d9-4e99-a764-9f783a72bafc req-91e65053-88d3-4ed3-a470-ff7fae1289f4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.677s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:41:53 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-72fa60e7-5084-475c-bd00-b2d3b4e2d37d tempest-ServerRescueNegativeTestJSON-435163099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf3f33fe-a8b1-4340-818b-bc7b4f3dcb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3083bde6-d495-43ef-9e92-a69d46d5416c', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:41:53 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-72fa60e7-5084-475c-bd00-b2d3b4e2d37d tempest-ServerRescueNegativeTestJSON-435163099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (537d703f-5442-4be3-aeea-48835116684f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:41:53 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-72fa60e7-5084-475c-bd00-b2d3b4e2d37d tempest-ServerRescueNegativeTestJSON-435163099 None] Volume volume-3083bde6-d495-43ef-9e92-a69d46d5416c (3083bde6-d495-43ef-9e92-a69d46d5416c): created successfully
Feb 28 04:41:53 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-72fa60e7-5084-475c-bd00-b2d3b4e2d37d tempest-ServerRescueNegativeTestJSON-435163099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (537d703f-5442-4be3-aeea-48835116684f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:41:53 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-72fa60e7-5084-475c-bd00-b2d3b4e2d37d tempest-ServerRescueNegativeTestJSON-435163099 None] Flow 'volume_create_manager' (20610123-d572-409a-8bc7-c2820f86fd3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:41:53 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e6a067-370f-464b-8a94-caf749ce14e6]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:41:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-b872b145-51d9-4e99-a764-9f783a72bafc req-91e65053-88d3-4ed3-a470-ff7fae1289f4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bf5fc4a3-ac9c-4cf6-949b-4e1fd2a8e7fa {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:41:53 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-72fa60e7-5084-475c-bd00-b2d3b4e2d37d tempest-ServerRescueNegativeTestJSON-435163099 None] Created volume successfully.
Feb 28 04:41:53 devstack sudo[85327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bf5fc4a3-ac9c-4cf6-949b-4e1fd2a8e7fa
Feb 28 04:41:53 devstack sudo[85327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:41:54 devstack sudo[85327]: pam_unix(sudo:session): session closed for user root
Feb 28 04:41:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-b872b145-51d9-4e99-a764-9f783a72bafc req-91e65053-88d3-4ed3-a470-ff7fae1289f4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bf5fc4a3-ac9c-4cf6-949b-4e1fd2a8e7fa" returned: 0 in 0.817s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:41:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-b872b145-51d9-4e99-a764-9f783a72bafc req-91e65053-88d3-4ed3-a470-ff7fae1289f4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.893s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:41:54 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-b872b145-51d9-4e99-a764-9f783a72bafc req-91e65053-88d3-4ed3-a470-ff7fae1289f4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035', 'name': 'volume-bf5fc4a3-ac9c-4cf6-949b-4e1fd2a8e7fa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd4384b28-dd23-44d9-be7a-bed5d5cc16fe', 'enforce_multipath': True} {{(pid=84248) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Feb 28 04:41:54 devstack cinder-volume[84248]: INFO cinder.volume.manager [req-b872b145-51d9-4e99-a764-9f783a72bafc req-91e65053-88d3-4ed3-a470-ff7fae1289f4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] attachment_update completed successfully.
Feb 28 04:42:04 devstack cinder-volume[84248]: DEBUG dbcounter [-] [84248] Writing DB stats cinder:SELECT=19,cinder:UPDATE=21,cinder:DELETE=1,cinder:INSERT=4 {{(pid=84248) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 04:42:04 devstack cinder-volume[84248]: DEBUG dbcounter [-] [84248] Writing DB stats cinder:UPDATE=16,cinder:SELECT=14,cinder:INSERT=3,cinder:DELETE=3 {{(pid=84248) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 04:42:05 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-e20de5d3-12a1-47b1-ba74-34362b500588 tempest-DeleteServersTestJSON-1600708696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:42:05 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e20de5d3-12a1-47b1-ba74-34362b500588 tempest-DeleteServersTestJSON-1600708696 None] Flow 'volume_create_manager' (522e253b-daa6-4b31-8e49-84f03072867c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:42:05 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e20de5d3-12a1-47b1-ba74-34362b500588 tempest-DeleteServersTestJSON-1600708696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b0a9b3c-fe96-4b3f-9bef-ee822624172d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:05 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e20de5d3-12a1-47b1-ba74-34362b500588 tempest-DeleteServersTestJSON-1600708696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b0a9b3c-fe96-4b3f-9bef-ee822624172d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-969694675',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70b15ce4-8515-4a3d-82e5-db6ebabff6d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87b61c5b055a484183a6408b0998581b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:42:05Z,use_quota=True,user_id='1aabd2c68af64d4191e1f9266845ad6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:42:05 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e20de5d3-12a1-47b1-ba74-34362b500588 tempest-DeleteServersTestJSON-1600708696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f5d3977-9cf4-49d4-a5f8-c3dee17417eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:05 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e20de5d3-12a1-47b1-ba74-34362b500588 tempest-DeleteServersTestJSON-1600708696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f5d3977-9cf4-49d4-a5f8-c3dee17417eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:42:05 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e20de5d3-12a1-47b1-ba74-34362b500588 tempest-DeleteServersTestJSON-1600708696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53f488d9-dea9-4fc5-bd93-e269bb789d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:05 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e20de5d3-12a1-47b1-ba74-34362b500588 tempest-DeleteServersTestJSON-1600708696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53f488d9-dea9-4fc5-bd93-e269bb789d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70b15ce4-8515-4a3d-82e5-db6ebabff6d0', 'volume_name': 'volume-70b15ce4-8515-4a3d-82e5-db6ebabff6d0', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:42:05 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e20de5d3-12a1-47b1-ba74-34362b500588 tempest-DeleteServersTestJSON-1600708696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad8150b9-ba59-490c-9878-41d002a11bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:05 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e20de5d3-12a1-47b1-ba74-34362b500588 tempest-DeleteServersTestJSON-1600708696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad8150b9-ba59-490c-9878-41d002a11bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:42:05 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e20de5d3-12a1-47b1-ba74-34362b500588 tempest-DeleteServersTestJSON-1600708696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30fd0948-df40-4dc2-b0cf-68a2319edea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:05 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-e20de5d3-12a1-47b1-ba74-34362b500588 tempest-DeleteServersTestJSON-1600708696 None] Volume 70b15ce4-8515-4a3d-82e5-db6ebabff6d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70b15ce4-8515-4a3d-82e5-db6ebabff6d0', 'volume_size': 1}
Feb 28 04:42:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e20de5d3-12a1-47b1-ba74-34362b500588 tempest-DeleteServersTestJSON-1600708696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:42:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e20de5d3-12a1-47b1-ba74-34362b500588 tempest-DeleteServersTestJSON-1600708696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:42:05 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-e20de5d3-12a1-47b1-ba74-34362b500588 tempest-DeleteServersTestJSON-1600708696 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-969694675',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70b15ce4-8515-4a3d-82e5-db6ebabff6d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87b61c5b055a484183a6408b0998581b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:42:05Z,use_quota=True,user_id='1aabd2c68af64d4191e1f9266845ad6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:42:05 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-e20de5d3-12a1-47b1-ba74-34362b500588 tempest-DeleteServersTestJSON-1600708696 None] Creating volume 70b15ce4-8515-4a3d-82e5-db6ebabff6d0 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:42:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e20de5d3-12a1-47b1-ba74-34362b500588 tempest-DeleteServersTestJSON-1600708696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:42:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e20de5d3-12a1-47b1-ba74-34362b500588 tempest-DeleteServersTestJSON-1600708696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:42:05 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-e20de5d3-12a1-47b1-ba74-34362b500588 tempest-DeleteServersTestJSON-1600708696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:42:05 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-e20de5d3-12a1-47b1-ba74-34362b500588 tempest-DeleteServersTestJSON-1600708696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:42:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e20de5d3-12a1-47b1-ba74-34362b500588 tempest-DeleteServersTestJSON-1600708696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:42:05 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-e20de5d3-12a1-47b1-ba74-34362b500588 tempest-DeleteServersTestJSON-1600708696 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:42:05 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-e20de5d3-12a1-47b1-ba74-34362b500588 tempest-DeleteServersTestJSON-1600708696 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:42:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e20de5d3-12a1-47b1-ba74-34362b500588 tempest-DeleteServersTestJSON-1600708696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-70b15ce4-8515-4a3d-82e5-db6ebabff6d0 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:05 devstack sudo[85848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-70b15ce4-8515-4a3d-82e5-db6ebabff6d0 1073741824
Feb 28 04:42:05 devstack sudo[85848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:06 devstack sudo[85848]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e20de5d3-12a1-47b1-ba74-34362b500588 tempest-DeleteServersTestJSON-1600708696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-70b15ce4-8515-4a3d-82e5-db6ebabff6d0 1073741824" returned: 0 in 1.037s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e20de5d3-12a1-47b1-ba74-34362b500588 tempest-DeleteServersTestJSON-1600708696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-70b15ce4-8515-4a3d-82e5-db6ebabff6d0 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:06 devstack sudo[85881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-70b15ce4-8515-4a3d-82e5-db6ebabff6d0
Feb 28 04:42:06 devstack sudo[85881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:07 devstack sudo[85881]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e20de5d3-12a1-47b1-ba74-34362b500588 tempest-DeleteServersTestJSON-1600708696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-70b15ce4-8515-4a3d-82e5-db6ebabff6d0" returned: 0 in 1.281s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:07 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-e20de5d3-12a1-47b1-ba74-34362b500588 tempest-DeleteServersTestJSON-1600708696 None] <== create_volume: return (2390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:42:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e20de5d3-12a1-47b1-ba74-34362b500588 tempest-DeleteServersTestJSON-1600708696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.394s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:42:07 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e20de5d3-12a1-47b1-ba74-34362b500588 tempest-DeleteServersTestJSON-1600708696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30fd0948-df40-4dc2-b0cf-68a2319edea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70b15ce4-8515-4a3d-82e5-db6ebabff6d0', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:42:07 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e20de5d3-12a1-47b1-ba74-34362b500588 tempest-DeleteServersTestJSON-1600708696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f33737c-74ca-4c3d-a044-a26fbc1c0c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:07 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-e20de5d3-12a1-47b1-ba74-34362b500588 tempest-DeleteServersTestJSON-1600708696 None] Volume volume-70b15ce4-8515-4a3d-82e5-db6ebabff6d0 (70b15ce4-8515-4a3d-82e5-db6ebabff6d0): created successfully
Feb 28 04:42:07 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e20de5d3-12a1-47b1-ba74-34362b500588 tempest-DeleteServersTestJSON-1600708696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f33737c-74ca-4c3d-a044-a26fbc1c0c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:42:07 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e20de5d3-12a1-47b1-ba74-34362b500588 tempest-DeleteServersTestJSON-1600708696 None] Flow 'volume_create_manager' (522e253b-daa6-4b31-8e49-84f03072867c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:42:07 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-e20de5d3-12a1-47b1-ba74-34362b500588 tempest-DeleteServersTestJSON-1600708696 None] Created volume successfully.
Feb 28 04:42:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-e9615c98-5ee9-47ba-83d8-ba9876f82e8f req-8be8ce46-b448-4141-b162-0ae3dc667aa4 tempest-DeleteServersTestJSON-1600708696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:42:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-e9615c98-5ee9-47ba-83d8-ba9876f82e8f req-8be8ce46-b448-4141-b162-0ae3dc667aa4 tempest-DeleteServersTestJSON-1600708696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:42:13 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd060929-091b-4362-b649-e02e29c38b0e]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:42:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-e9615c98-5ee9-47ba-83d8-ba9876f82e8f req-8be8ce46-b448-4141-b162-0ae3dc667aa4 tempest-DeleteServersTestJSON-1600708696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-70b15ce4-8515-4a3d-82e5-db6ebabff6d0 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:13 devstack sudo[86001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-70b15ce4-8515-4a3d-82e5-db6ebabff6d0
Feb 28 04:42:13 devstack sudo[86001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:14 devstack sudo[86001]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-e9615c98-5ee9-47ba-83d8-ba9876f82e8f req-8be8ce46-b448-4141-b162-0ae3dc667aa4 tempest-DeleteServersTestJSON-1600708696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-70b15ce4-8515-4a3d-82e5-db6ebabff6d0" returned: 0 in 1.115s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-e9615c98-5ee9-47ba-83d8-ba9876f82e8f req-8be8ce46-b448-4141-b162-0ae3dc667aa4 tempest-DeleteServersTestJSON-1600708696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.149s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:42:14 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-e9615c98-5ee9-47ba-83d8-ba9876f82e8f req-8be8ce46-b448-4141-b162-0ae3dc667aa4 tempest-DeleteServersTestJSON-1600708696 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035', 'name': 'volume-70b15ce4-8515-4a3d-82e5-db6ebabff6d0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd6dca77f-e2c2-45d7-886c-735bee460833', 'enforce_multipath': True} {{(pid=84248) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Feb 28 04:42:14 devstack cinder-volume[84248]: INFO cinder.volume.manager [req-e9615c98-5ee9-47ba-83d8-ba9876f82e8f req-8be8ce46-b448-4141-b162-0ae3dc667aa4 tempest-DeleteServersTestJSON-1600708696 None] attachment_update completed successfully.
Feb 28 04:42:15 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-29e7c93a-10bf-4d53-b631-ebc2b5e45689 tempest-ServerRescueNegativeTestJSON-435163099 None] Acquiring lock "cinder-3083bde6-d495-43ef-9e92-a69d46d5416c-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:42:15 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-29e7c93a-10bf-4d53-b631-ebc2b5e45689 tempest-ServerRescueNegativeTestJSON-435163099 None] Lock "cinder-3083bde6-d495-43ef-9e92-a69d46d5416c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:42:15 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-29e7c93a-10bf-4d53-b631-ebc2b5e45689 tempest-ServerRescueNegativeTestJSON-435163099 None] Acquiring lock "cinder-quobyte-3083bde6-d495-43ef-9e92-a69d46d5416c" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:42:15 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-29e7c93a-10bf-4d53-b631-ebc2b5e45689 tempest-ServerRescueNegativeTestJSON-435163099 None] Lock "cinder-quobyte-3083bde6-d495-43ef-9e92-a69d46d5416c" acquired by "delete_volume" :: waited 0.020s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:42:15 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-320c8a2c-bb41-44ea-9e20-8720946a9b64 tempest-VolumesTestJSON-902591685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:42:15 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-320c8a2c-bb41-44ea-9e20-8720946a9b64 tempest-VolumesTestJSON-902591685 None] Flow 'volume_create_manager' (a9217152-6b5e-47b0-bf2c-b7f755cf4c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:42:15 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-320c8a2c-bb41-44ea-9e20-8720946a9b64 tempest-VolumesTestJSON-902591685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31e96e93-327e-4052-a2ee-9c9f47a2a8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:15 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9be43b2-1f6a-4d96-a94a-a9f376806c3e]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:42:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-29e7c93a-10bf-4d53-b631-ebc2b5e45689 tempest-ServerRescueNegativeTestJSON-435163099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3083bde6-d495-43ef-9e92-a69d46d5416c {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:15 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-320c8a2c-bb41-44ea-9e20-8720946a9b64 tempest-VolumesTestJSON-902591685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31e96e93-327e-4052-a2ee-9c9f47a2a8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-832611038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=558a5580-2088-4a17-a25b-ffbf25e8e84a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='01c4f698ffc64e9fba912ed06e2f5ca5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:42:15Z,use_quota=True,user_id='20a850fff510421b83cb90ea27a6c207',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:42:15 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-320c8a2c-bb41-44ea-9e20-8720946a9b64 tempest-VolumesTestJSON-902591685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bdba4ea-eaf5-4f8f-a0e2-187bdf8609a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:15 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-320c8a2c-bb41-44ea-9e20-8720946a9b64 tempest-VolumesTestJSON-902591685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bdba4ea-eaf5-4f8f-a0e2-187bdf8609a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:42:15 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-320c8a2c-bb41-44ea-9e20-8720946a9b64 tempest-VolumesTestJSON-902591685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4004a56-fa4f-4f1d-9957-5ab962e0f3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:15 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-320c8a2c-bb41-44ea-9e20-8720946a9b64 tempest-VolumesTestJSON-902591685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4004a56-fa4f-4f1d-9957-5ab962e0f3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '558a5580-2088-4a17-a25b-ffbf25e8e84a', 'volume_name': 'volume-558a5580-2088-4a17-a25b-ffbf25e8e84a', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:42:15 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-320c8a2c-bb41-44ea-9e20-8720946a9b64 tempest-VolumesTestJSON-902591685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19f1cc2a-6d15-4b51-940d-868468e4b69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:15 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-320c8a2c-bb41-44ea-9e20-8720946a9b64 tempest-VolumesTestJSON-902591685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19f1cc2a-6d15-4b51-940d-868468e4b69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:42:15 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-320c8a2c-bb41-44ea-9e20-8720946a9b64 tempest-VolumesTestJSON-902591685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ce6884d-2075-469f-b9a7-177f3648b9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:15 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-320c8a2c-bb41-44ea-9e20-8720946a9b64 tempest-VolumesTestJSON-902591685 None] Volume 558a5580-2088-4a17-a25b-ffbf25e8e84a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-558a5580-2088-4a17-a25b-ffbf25e8e84a', 'volume_size': 1}
Feb 28 04:42:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-320c8a2c-bb41-44ea-9e20-8720946a9b64 tempest-VolumesTestJSON-902591685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:42:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-320c8a2c-bb41-44ea-9e20-8720946a9b64 tempest-VolumesTestJSON-902591685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:42:15 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-320c8a2c-bb41-44ea-9e20-8720946a9b64 tempest-VolumesTestJSON-902591685 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-832611038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=558a5580-2088-4a17-a25b-ffbf25e8e84a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='01c4f698ffc64e9fba912ed06e2f5ca5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:42:15Z,use_quota=True,user_id='20a850fff510421b83cb90ea27a6c207',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:42:15 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-320c8a2c-bb41-44ea-9e20-8720946a9b64 tempest-VolumesTestJSON-902591685 None] Creating volume 558a5580-2088-4a17-a25b-ffbf25e8e84a {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:42:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-320c8a2c-bb41-44ea-9e20-8720946a9b64 tempest-VolumesTestJSON-902591685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:42:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-320c8a2c-bb41-44ea-9e20-8720946a9b64 tempest-VolumesTestJSON-902591685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:42:15 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-320c8a2c-bb41-44ea-9e20-8720946a9b64 tempest-VolumesTestJSON-902591685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:42:15 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-320c8a2c-bb41-44ea-9e20-8720946a9b64 tempest-VolumesTestJSON-902591685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:42:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-320c8a2c-bb41-44ea-9e20-8720946a9b64 tempest-VolumesTestJSON-902591685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:42:15 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-320c8a2c-bb41-44ea-9e20-8720946a9b64 tempest-VolumesTestJSON-902591685 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:42:15 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-320c8a2c-bb41-44ea-9e20-8720946a9b64 tempest-VolumesTestJSON-902591685 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:42:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-320c8a2c-bb41-44ea-9e20-8720946a9b64 tempest-VolumesTestJSON-902591685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-558a5580-2088-4a17-a25b-ffbf25e8e84a 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:15 devstack sudo[86044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-558a5580-2088-4a17-a25b-ffbf25e8e84a 1073741824
Feb 28 04:42:15 devstack sudo[86044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:15 devstack sudo[86015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3083bde6-d495-43ef-9e92-a69d46d5416c
Feb 28 04:42:15 devstack sudo[86015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:16 devstack sudo[86015]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-29e7c93a-10bf-4d53-b631-ebc2b5e45689 tempest-ServerRescueNegativeTestJSON-435163099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3083bde6-d495-43ef-9e92-a69d46d5416c" returned: 0 in 1.140s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-29e7c93a-10bf-4d53-b631-ebc2b5e45689 tempest-ServerRescueNegativeTestJSON-435163099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3083bde6-d495-43ef-9e92-a69d46d5416c {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:16 devstack sudo[86077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3083bde6-d495-43ef-9e92-a69d46d5416c
Feb 28 04:42:16 devstack sudo[86077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:16 devstack sudo[86044]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-320c8a2c-bb41-44ea-9e20-8720946a9b64 tempest-VolumesTestJSON-902591685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-558a5580-2088-4a17-a25b-ffbf25e8e84a 1073741824" returned: 0 in 1.405s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-320c8a2c-bb41-44ea-9e20-8720946a9b64 tempest-VolumesTestJSON-902591685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-558a5580-2088-4a17-a25b-ffbf25e8e84a {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:17 devstack sudo[86082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-558a5580-2088-4a17-a25b-ffbf25e8e84a
Feb 28 04:42:17 devstack sudo[86082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:17 devstack sudo[86077]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-29e7c93a-10bf-4d53-b631-ebc2b5e45689 tempest-ServerRescueNegativeTestJSON-435163099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3083bde6-d495-43ef-9e92-a69d46d5416c" returned: 0 in 0.778s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:17 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-29e7c93a-10bf-4d53-b631-ebc2b5e45689 tempest-ServerRescueNegativeTestJSON-435163099 None] Lock "cinder-quobyte-3083bde6-d495-43ef-9e92-a69d46d5416c" released by "delete_volume" :: held 2.023s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:42:17 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-29e7c93a-10bf-4d53-b631-ebc2b5e45689 tempest-ServerRescueNegativeTestJSON-435163099 None] Created reservations ['76ae2000-4db1-4c5a-b8f8-be1d46b64167', '78ef83ce-d445-46e2-acf7-4228a072b996', '6dd3462d-dbe3-4dee-8516-ddc621334611', '8e6304a3-3342-45b1-be94-bb3434217ffa'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:42:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-29e7c93a-10bf-4d53-b631-ebc2b5e45689 tempest-ServerRescueNegativeTestJSON-435163099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:42:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-29e7c93a-10bf-4d53-b631-ebc2b5e45689 tempest-ServerRescueNegativeTestJSON-435163099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:42:17 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-29e7c93a-10bf-4d53-b631-ebc2b5e45689 tempest-ServerRescueNegativeTestJSON-435163099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:42:17 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-29e7c93a-10bf-4d53-b631-ebc2b5e45689 tempest-ServerRescueNegativeTestJSON-435163099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:42:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-29e7c93a-10bf-4d53-b631-ebc2b5e45689 tempest-ServerRescueNegativeTestJSON-435163099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:42:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-29e7c93a-10bf-4d53-b631-ebc2b5e45689 tempest-ServerRescueNegativeTestJSON-435163099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:17 devstack sudo[86110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:42:17 devstack sudo[86110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:17 devstack sudo[86082]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-320c8a2c-bb41-44ea-9e20-8720946a9b64 tempest-VolumesTestJSON-902591685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-558a5580-2088-4a17-a25b-ffbf25e8e84a" returned: 0 in 0.714s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:17 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-320c8a2c-bb41-44ea-9e20-8720946a9b64 tempest-VolumesTestJSON-902591685 None] <== create_volume: return (2197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:42:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-320c8a2c-bb41-44ea-9e20-8720946a9b64 tempest-VolumesTestJSON-902591685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.204s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:42:17 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-320c8a2c-bb41-44ea-9e20-8720946a9b64 tempest-VolumesTestJSON-902591685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ce6884d-2075-469f-b9a7-177f3648b9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-558a5580-2088-4a17-a25b-ffbf25e8e84a', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:42:17 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-320c8a2c-bb41-44ea-9e20-8720946a9b64 tempest-VolumesTestJSON-902591685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d1eda1d-f320-4594-ac75-90b73187b5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:17 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-320c8a2c-bb41-44ea-9e20-8720946a9b64 tempest-VolumesTestJSON-902591685 None] Volume volume-558a5580-2088-4a17-a25b-ffbf25e8e84a (558a5580-2088-4a17-a25b-ffbf25e8e84a): created successfully
Feb 28 04:42:17 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-320c8a2c-bb41-44ea-9e20-8720946a9b64 tempest-VolumesTestJSON-902591685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d1eda1d-f320-4594-ac75-90b73187b5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:42:17 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-320c8a2c-bb41-44ea-9e20-8720946a9b64 tempest-VolumesTestJSON-902591685 None] Flow 'volume_create_manager' (a9217152-6b5e-47b0-bf2c-b7f755cf4c1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:42:17 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-320c8a2c-bb41-44ea-9e20-8720946a9b64 tempest-VolumesTestJSON-902591685 None] Created volume successfully.
Feb 28 04:42:18 devstack sudo[86110]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-29e7c93a-10bf-4d53-b631-ebc2b5e45689 tempest-ServerRescueNegativeTestJSON-435163099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.565s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:18 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-29e7c93a-10bf-4d53-b631-ebc2b5e45689 tempest-ServerRescueNegativeTestJSON-435163099 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:42:18 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-29e7c93a-10bf-4d53-b631-ebc2b5e45689 tempest-ServerRescueNegativeTestJSON-435163099 None] Deleted volume successfully.
Feb 28 04:42:18 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-29e7c93a-10bf-4d53-b631-ebc2b5e45689 tempest-ServerRescueNegativeTestJSON-435163099 None] Lock "cinder-3083bde6-d495-43ef-9e92-a69d46d5416c-delete_volume" released by "delete_volume" :: held 2.886s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:42:19 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-9879497e-1d10-498d-8392-cf418d8b6b2e tempest-VolumesTestJSON-902591685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:42:19 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9879497e-1d10-498d-8392-cf418d8b6b2e tempest-VolumesTestJSON-902591685 None] Flow 'volume_create_manager' (d7a3cd54-3dd6-4566-9e7c-b76786da3393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:42:19 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9879497e-1d10-498d-8392-cf418d8b6b2e tempest-VolumesTestJSON-902591685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13daf7c6-7f7b-4d73-9c22-014903cc5716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:19 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9879497e-1d10-498d-8392-cf418d8b6b2e tempest-VolumesTestJSON-902591685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13daf7c6-7f7b-4d73-9c22-014903cc5716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-492239179',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbbf5f0a-458f-428f-baf8-b1cd2d3e7e28,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='01c4f698ffc64e9fba912ed06e2f5ca5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:42:20Z,use_quota=True,user_id='20a850fff510421b83cb90ea27a6c207',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:42:19 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9879497e-1d10-498d-8392-cf418d8b6b2e tempest-VolumesTestJSON-902591685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e91039e9-79ee-43e7-8acc-aa105ed9d652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:19 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9879497e-1d10-498d-8392-cf418d8b6b2e tempest-VolumesTestJSON-902591685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e91039e9-79ee-43e7-8acc-aa105ed9d652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:42:19 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9879497e-1d10-498d-8392-cf418d8b6b2e tempest-VolumesTestJSON-902591685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e994c8f7-96c8-4544-b945-66c33957ab52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:19 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9879497e-1d10-498d-8392-cf418d8b6b2e tempest-VolumesTestJSON-902591685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e994c8f7-96c8-4544-b945-66c33957ab52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbbf5f0a-458f-428f-baf8-b1cd2d3e7e28', 'volume_name': 'volume-cbbf5f0a-458f-428f-baf8-b1cd2d3e7e28', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:42:19 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9879497e-1d10-498d-8392-cf418d8b6b2e tempest-VolumesTestJSON-902591685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8ce30a6-6ad1-4049-a07b-67d29156cf37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:19 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9879497e-1d10-498d-8392-cf418d8b6b2e tempest-VolumesTestJSON-902591685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8ce30a6-6ad1-4049-a07b-67d29156cf37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:42:19 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9879497e-1d10-498d-8392-cf418d8b6b2e tempest-VolumesTestJSON-902591685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae56beda-e56b-4f78-92a1-201ade5c8650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:19 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-9879497e-1d10-498d-8392-cf418d8b6b2e tempest-VolumesTestJSON-902591685 None] Volume cbbf5f0a-458f-428f-baf8-b1cd2d3e7e28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbbf5f0a-458f-428f-baf8-b1cd2d3e7e28', 'volume_size': 1}
Feb 28 04:42:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-9879497e-1d10-498d-8392-cf418d8b6b2e tempest-VolumesTestJSON-902591685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:42:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-9879497e-1d10-498d-8392-cf418d8b6b2e tempest-VolumesTestJSON-902591685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:42:19 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-9879497e-1d10-498d-8392-cf418d8b6b2e tempest-VolumesTestJSON-902591685 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-492239179',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbbf5f0a-458f-428f-baf8-b1cd2d3e7e28,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='01c4f698ffc64e9fba912ed06e2f5ca5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:42:20Z,use_quota=True,user_id='20a850fff510421b83cb90ea27a6c207',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:42:19 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-9879497e-1d10-498d-8392-cf418d8b6b2e tempest-VolumesTestJSON-902591685 None] Creating volume cbbf5f0a-458f-428f-baf8-b1cd2d3e7e28 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:42:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-9879497e-1d10-498d-8392-cf418d8b6b2e tempest-VolumesTestJSON-902591685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:42:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-9879497e-1d10-498d-8392-cf418d8b6b2e tempest-VolumesTestJSON-902591685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:42:19 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-9879497e-1d10-498d-8392-cf418d8b6b2e tempest-VolumesTestJSON-902591685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:42:19 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-9879497e-1d10-498d-8392-cf418d8b6b2e tempest-VolumesTestJSON-902591685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:42:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-9879497e-1d10-498d-8392-cf418d8b6b2e tempest-VolumesTestJSON-902591685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:42:19 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-9879497e-1d10-498d-8392-cf418d8b6b2e tempest-VolumesTestJSON-902591685 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:42:19 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-9879497e-1d10-498d-8392-cf418d8b6b2e tempest-VolumesTestJSON-902591685 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:42:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9879497e-1d10-498d-8392-cf418d8b6b2e tempest-VolumesTestJSON-902591685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-cbbf5f0a-458f-428f-baf8-b1cd2d3e7e28 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:19 devstack sudo[86132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-cbbf5f0a-458f-428f-baf8-b1cd2d3e7e28 1073741824
Feb 28 04:42:19 devstack sudo[86132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:21 devstack sudo[86132]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9879497e-1d10-498d-8392-cf418d8b6b2e tempest-VolumesTestJSON-902591685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-cbbf5f0a-458f-428f-baf8-b1cd2d3e7e28 1073741824" returned: 0 in 1.348s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9879497e-1d10-498d-8392-cf418d8b6b2e tempest-VolumesTestJSON-902591685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-cbbf5f0a-458f-428f-baf8-b1cd2d3e7e28 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:21 devstack sudo[86162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-cbbf5f0a-458f-428f-baf8-b1cd2d3e7e28
Feb 28 04:42:21 devstack sudo[86162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:22 devstack sudo[86162]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9879497e-1d10-498d-8392-cf418d8b6b2e tempest-VolumesTestJSON-902591685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-cbbf5f0a-458f-428f-baf8-b1cd2d3e7e28" returned: 0 in 1.157s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:22 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-9879497e-1d10-498d-8392-cf418d8b6b2e tempest-VolumesTestJSON-902591685 None] <== create_volume: return (2589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:42:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-9879497e-1d10-498d-8392-cf418d8b6b2e tempest-VolumesTestJSON-902591685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.592s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:42:22 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9879497e-1d10-498d-8392-cf418d8b6b2e tempest-VolumesTestJSON-902591685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae56beda-e56b-4f78-92a1-201ade5c8650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbbf5f0a-458f-428f-baf8-b1cd2d3e7e28', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:42:22 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9879497e-1d10-498d-8392-cf418d8b6b2e tempest-VolumesTestJSON-902591685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3259fe2e-80ee-49ec-9cf6-acec26f39ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:22 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-9879497e-1d10-498d-8392-cf418d8b6b2e tempest-VolumesTestJSON-902591685 None] Volume volume-cbbf5f0a-458f-428f-baf8-b1cd2d3e7e28 (cbbf5f0a-458f-428f-baf8-b1cd2d3e7e28): created successfully
Feb 28 04:42:22 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9879497e-1d10-498d-8392-cf418d8b6b2e tempest-VolumesTestJSON-902591685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3259fe2e-80ee-49ec-9cf6-acec26f39ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:42:22 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9879497e-1d10-498d-8392-cf418d8b6b2e tempest-VolumesTestJSON-902591685 None] Flow 'volume_create_manager' (d7a3cd54-3dd6-4566-9e7c-b76786da3393) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:42:22 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-9879497e-1d10-498d-8392-cf418d8b6b2e tempest-VolumesTestJSON-902591685 None] Created volume successfully.
Feb 28 04:42:23 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-42b3227e-b649-48e8-a1cf-645094702a0c tempest-VolumesTestJSON-902591685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:42:23 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-42b3227e-b649-48e8-a1cf-645094702a0c tempest-VolumesTestJSON-902591685 None] Flow 'volume_create_manager' (6c23678f-a8ee-463b-b00b-c191f1eb5026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:42:23 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-42b3227e-b649-48e8-a1cf-645094702a0c tempest-VolumesTestJSON-902591685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e72590-c87d-41c8-8a34-f3d8c39c3bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:23 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-42b3227e-b649-48e8-a1cf-645094702a0c tempest-VolumesTestJSON-902591685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e72590-c87d-41c8-8a34-f3d8c39c3bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1479909687',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7ed3158-6f3e-42db-a32e-c303619fffa8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='01c4f698ffc64e9fba912ed06e2f5ca5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:42:23Z,use_quota=True,user_id='20a850fff510421b83cb90ea27a6c207',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:42:23 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-42b3227e-b649-48e8-a1cf-645094702a0c tempest-VolumesTestJSON-902591685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50e4f8cd-797c-4f49-8a49-924df07c4340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:23 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-42b3227e-b649-48e8-a1cf-645094702a0c tempest-VolumesTestJSON-902591685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50e4f8cd-797c-4f49-8a49-924df07c4340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:42:23 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-42b3227e-b649-48e8-a1cf-645094702a0c tempest-VolumesTestJSON-902591685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbaa44c8-3be8-453c-9f9a-c3e0c4a7188d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:23 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-42b3227e-b649-48e8-a1cf-645094702a0c tempest-VolumesTestJSON-902591685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbaa44c8-3be8-453c-9f9a-c3e0c4a7188d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7ed3158-6f3e-42db-a32e-c303619fffa8', 'volume_name': 'volume-b7ed3158-6f3e-42db-a32e-c303619fffa8', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:42:23 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-42b3227e-b649-48e8-a1cf-645094702a0c tempest-VolumesTestJSON-902591685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (348fd155-521a-455a-b874-2ccbf9bb178f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:23 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-42b3227e-b649-48e8-a1cf-645094702a0c tempest-VolumesTestJSON-902591685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (348fd155-521a-455a-b874-2ccbf9bb178f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:42:23 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-42b3227e-b649-48e8-a1cf-645094702a0c tempest-VolumesTestJSON-902591685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d74a40c-804e-49de-8687-6ec7abf8dd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:23 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-42b3227e-b649-48e8-a1cf-645094702a0c tempest-VolumesTestJSON-902591685 None] Volume b7ed3158-6f3e-42db-a32e-c303619fffa8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7ed3158-6f3e-42db-a32e-c303619fffa8', 'volume_size': 1}
Feb 28 04:42:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-42b3227e-b649-48e8-a1cf-645094702a0c tempest-VolumesTestJSON-902591685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:42:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-42b3227e-b649-48e8-a1cf-645094702a0c tempest-VolumesTestJSON-902591685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:42:23 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-42b3227e-b649-48e8-a1cf-645094702a0c tempest-VolumesTestJSON-902591685 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1479909687',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7ed3158-6f3e-42db-a32e-c303619fffa8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='01c4f698ffc64e9fba912ed06e2f5ca5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:42:23Z,use_quota=True,user_id='20a850fff510421b83cb90ea27a6c207',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:42:23 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-42b3227e-b649-48e8-a1cf-645094702a0c tempest-VolumesTestJSON-902591685 None] Creating volume b7ed3158-6f3e-42db-a32e-c303619fffa8 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:42:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-42b3227e-b649-48e8-a1cf-645094702a0c tempest-VolumesTestJSON-902591685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:42:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-42b3227e-b649-48e8-a1cf-645094702a0c tempest-VolumesTestJSON-902591685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:42:23 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-42b3227e-b649-48e8-a1cf-645094702a0c tempest-VolumesTestJSON-902591685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:42:23 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-42b3227e-b649-48e8-a1cf-645094702a0c tempest-VolumesTestJSON-902591685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:42:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-42b3227e-b649-48e8-a1cf-645094702a0c tempest-VolumesTestJSON-902591685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:42:23 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-42b3227e-b649-48e8-a1cf-645094702a0c tempest-VolumesTestJSON-902591685 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:42:23 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-42b3227e-b649-48e8-a1cf-645094702a0c tempest-VolumesTestJSON-902591685 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:42:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-42b3227e-b649-48e8-a1cf-645094702a0c tempest-VolumesTestJSON-902591685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b7ed3158-6f3e-42db-a32e-c303619fffa8 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:23 devstack sudo[86213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b7ed3158-6f3e-42db-a32e-c303619fffa8 1073741824
Feb 28 04:42:23 devstack sudo[86213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:23 devstack cinder-volume[84248]: INFO cinder.volume.manager [req-793b8b5d-3de3-4d33-827f-fff04b18d1b3 req-39339843-fdd8-4507-8a6b-03689f37eef9 tempest-DeleteServersTestJSON-1600708696 None] Terminate volume connection completed successfully.
Feb 28 04:42:23 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-793b8b5d-3de3-4d33-827f-fff04b18d1b3 req-39339843-fdd8-4507-8a6b-03689f37eef9 tempest-DeleteServersTestJSON-1600708696 None] Deleting attachment d6dca77f-e2c2-45d7-886c-735bee460833. {{(pid=84248) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Feb 28 04:42:24 devstack sudo[86213]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-42b3227e-b649-48e8-a1cf-645094702a0c tempest-VolumesTestJSON-902591685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b7ed3158-6f3e-42db-a32e-c303619fffa8 1073741824" returned: 0 in 0.768s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-42b3227e-b649-48e8-a1cf-645094702a0c tempest-VolumesTestJSON-902591685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b7ed3158-6f3e-42db-a32e-c303619fffa8 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:24 devstack sudo[86237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b7ed3158-6f3e-42db-a32e-c303619fffa8
Feb 28 04:42:24 devstack sudo[86237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:24 devstack cinder-volume[84248]: DEBUG oslo_service.periodic_task [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84248) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 28 04:42:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:42:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:42:24 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:42:24 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:42:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:42:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:24 devstack sudo[86240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:42:24 devstack sudo[86240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:24 devstack sudo[86237]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-42b3227e-b649-48e8-a1cf-645094702a0c tempest-VolumesTestJSON-902591685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b7ed3158-6f3e-42db-a32e-c303619fffa8" returned: 0 in 0.552s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:24 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-42b3227e-b649-48e8-a1cf-645094702a0c tempest-VolumesTestJSON-902591685 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:42:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-42b3227e-b649-48e8-a1cf-645094702a0c tempest-VolumesTestJSON-902591685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.358s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:42:24 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-42b3227e-b649-48e8-a1cf-645094702a0c tempest-VolumesTestJSON-902591685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d74a40c-804e-49de-8687-6ec7abf8dd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7ed3158-6f3e-42db-a32e-c303619fffa8', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:42:24 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-42b3227e-b649-48e8-a1cf-645094702a0c tempest-VolumesTestJSON-902591685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed6be47-0ce1-4497-bd7c-0437a9572ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:24 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-42b3227e-b649-48e8-a1cf-645094702a0c tempest-VolumesTestJSON-902591685 None] Volume volume-b7ed3158-6f3e-42db-a32e-c303619fffa8 (b7ed3158-6f3e-42db-a32e-c303619fffa8): created successfully
Feb 28 04:42:24 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-42b3227e-b649-48e8-a1cf-645094702a0c tempest-VolumesTestJSON-902591685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed6be47-0ce1-4497-bd7c-0437a9572ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:42:24 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-42b3227e-b649-48e8-a1cf-645094702a0c tempest-VolumesTestJSON-902591685 None] Flow 'volume_create_manager' (6c23678f-a8ee-463b-b00b-c191f1eb5026) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:42:24 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-42b3227e-b649-48e8-a1cf-645094702a0c tempest-VolumesTestJSON-902591685 None] Created volume successfully.
Feb 28 04:42:25 devstack sudo[86240]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.518s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:25 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:42:26 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-253756cc-f641-480b-94a6-8e20e07f799a tempest-VolumesTestJSON-902591685 None] Acquiring lock "cinder-b7ed3158-6f3e-42db-a32e-c303619fffa8-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:42:26 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-253756cc-f641-480b-94a6-8e20e07f799a tempest-VolumesTestJSON-902591685 None] Lock "cinder-b7ed3158-6f3e-42db-a32e-c303619fffa8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:42:26 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-253756cc-f641-480b-94a6-8e20e07f799a tempest-VolumesTestJSON-902591685 None] Acquiring lock "cinder-quobyte-b7ed3158-6f3e-42db-a32e-c303619fffa8" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:42:26 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-253756cc-f641-480b-94a6-8e20e07f799a tempest-VolumesTestJSON-902591685 None] Lock "cinder-quobyte-b7ed3158-6f3e-42db-a32e-c303619fffa8" acquired by "delete_volume" :: waited 0.015s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:42:26 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0eecc3-4f35-4c36-8f42-7e35d79983c1]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:42:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-253756cc-f641-480b-94a6-8e20e07f799a tempest-VolumesTestJSON-902591685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b7ed3158-6f3e-42db-a32e-c303619fffa8 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:26 devstack sudo[86247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b7ed3158-6f3e-42db-a32e-c303619fffa8
Feb 28 04:42:26 devstack sudo[86247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:27 devstack sudo[86247]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:27 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-253756cc-f641-480b-94a6-8e20e07f799a tempest-VolumesTestJSON-902591685 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b7ed3158-6f3e-42db-a32e-c303619fffa8" returned: 0 in 0.546s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:27 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-253756cc-f641-480b-94a6-8e20e07f799a tempest-VolumesTestJSON-902591685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b7ed3158-6f3e-42db-a32e-c303619fffa8 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:27 devstack sudo[86252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b7ed3158-6f3e-42db-a32e-c303619fffa8
Feb 28 04:42:27 devstack sudo[86252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:27 devstack sudo[86252]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:27 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-253756cc-f641-480b-94a6-8e20e07f799a tempest-VolumesTestJSON-902591685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b7ed3158-6f3e-42db-a32e-c303619fffa8" returned: 0 in 0.479s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:27 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-253756cc-f641-480b-94a6-8e20e07f799a tempest-VolumesTestJSON-902591685 None] Lock "cinder-quobyte-b7ed3158-6f3e-42db-a32e-c303619fffa8" released by "delete_volume" :: held 1.073s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:42:27 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-253756cc-f641-480b-94a6-8e20e07f799a tempest-VolumesTestJSON-902591685 None] Created reservations ['6a2f0fc2-455e-4eca-b8a2-135c624093d5', '827e8677-75bc-4ea4-9c22-11bc33948ed9', 'af0f3d3d-98b0-4fe6-96a9-a220a0960a32', 'f2d76ecd-3728-4329-99cd-c4c983137129'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:42:27 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-253756cc-f641-480b-94a6-8e20e07f799a tempest-VolumesTestJSON-902591685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:42:27 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-253756cc-f641-480b-94a6-8e20e07f799a tempest-VolumesTestJSON-902591685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:42:27 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-253756cc-f641-480b-94a6-8e20e07f799a tempest-VolumesTestJSON-902591685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:42:27 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-253756cc-f641-480b-94a6-8e20e07f799a tempest-VolumesTestJSON-902591685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:42:27 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-253756cc-f641-480b-94a6-8e20e07f799a tempest-VolumesTestJSON-902591685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:42:27 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-253756cc-f641-480b-94a6-8e20e07f799a tempest-VolumesTestJSON-902591685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:27 devstack sudo[86255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:42:27 devstack sudo[86255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:28 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-3a24b985-b872-4cae-82a7-90dad6965018 tempest-DeleteServersTestJSON-1600708696 None] Acquiring lock "cinder-70b15ce4-8515-4a3d-82e5-db6ebabff6d0-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:42:28 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-3a24b985-b872-4cae-82a7-90dad6965018 tempest-DeleteServersTestJSON-1600708696 None] Lock "cinder-70b15ce4-8515-4a3d-82e5-db6ebabff6d0-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:42:28 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-3a24b985-b872-4cae-82a7-90dad6965018 tempest-DeleteServersTestJSON-1600708696 None] Acquiring lock "cinder-quobyte-70b15ce4-8515-4a3d-82e5-db6ebabff6d0" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:42:28 devstack sudo[86255]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-253756cc-f641-480b-94a6-8e20e07f799a tempest-VolumesTestJSON-902591685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.504s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:28 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-3a24b985-b872-4cae-82a7-90dad6965018 tempest-DeleteServersTestJSON-1600708696 None] Lock "cinder-quobyte-70b15ce4-8515-4a3d-82e5-db6ebabff6d0" acquired by "delete_volume" :: waited 0.014s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:42:28 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-253756cc-f641-480b-94a6-8e20e07f799a tempest-VolumesTestJSON-902591685 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:42:28 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-253756cc-f641-480b-94a6-8e20e07f799a tempest-VolumesTestJSON-902591685 None] Deleted volume successfully.
Feb 28 04:42:28 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[b112f28f-e69d-4830-a765-0e44c8f6e10d]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:42:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3a24b985-b872-4cae-82a7-90dad6965018 tempest-DeleteServersTestJSON-1600708696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-70b15ce4-8515-4a3d-82e5-db6ebabff6d0 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:28 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-253756cc-f641-480b-94a6-8e20e07f799a tempest-VolumesTestJSON-902591685 None] Lock "cinder-b7ed3158-6f3e-42db-a32e-c303619fffa8-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:42:28 devstack sudo[86265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-70b15ce4-8515-4a3d-82e5-db6ebabff6d0
Feb 28 04:42:28 devstack sudo[86265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:28 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-83f0f672-9e8f-43e5-aa6c-07e70be49a99 tempest-VolumesTestJSON-902591685 None] Acquiring lock "cinder-cbbf5f0a-458f-428f-baf8-b1cd2d3e7e28-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:42:28 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-83f0f672-9e8f-43e5-aa6c-07e70be49a99 tempest-VolumesTestJSON-902591685 None] Lock "cinder-cbbf5f0a-458f-428f-baf8-b1cd2d3e7e28-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:42:28 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-83f0f672-9e8f-43e5-aa6c-07e70be49a99 tempest-VolumesTestJSON-902591685 None] Acquiring lock "cinder-quobyte-cbbf5f0a-458f-428f-baf8-b1cd2d3e7e28" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:42:28 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-83f0f672-9e8f-43e5-aa6c-07e70be49a99 tempest-VolumesTestJSON-902591685 None] Lock "cinder-quobyte-cbbf5f0a-458f-428f-baf8-b1cd2d3e7e28" acquired by "delete_volume" :: waited 0.033s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:42:28 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[97706d43-feb5-4899-aba6-245c948a0c1e]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:42:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-83f0f672-9e8f-43e5-aa6c-07e70be49a99 tempest-VolumesTestJSON-902591685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-cbbf5f0a-458f-428f-baf8-b1cd2d3e7e28 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:28 devstack sudo[86296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-cbbf5f0a-458f-428f-baf8-b1cd2d3e7e28
Feb 28 04:42:28 devstack sudo[86296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:28 devstack sudo[86265]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3a24b985-b872-4cae-82a7-90dad6965018 tempest-DeleteServersTestJSON-1600708696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-70b15ce4-8515-4a3d-82e5-db6ebabff6d0" returned: 0 in 0.746s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3a24b985-b872-4cae-82a7-90dad6965018 tempest-DeleteServersTestJSON-1600708696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-70b15ce4-8515-4a3d-82e5-db6ebabff6d0 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:28 devstack sudo[86301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-70b15ce4-8515-4a3d-82e5-db6ebabff6d0
Feb 28 04:42:29 devstack sudo[86301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:29 devstack sudo[86296]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-83f0f672-9e8f-43e5-aa6c-07e70be49a99 tempest-VolumesTestJSON-902591685 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-cbbf5f0a-458f-428f-baf8-b1cd2d3e7e28" returned: 0 in 0.503s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-83f0f672-9e8f-43e5-aa6c-07e70be49a99 tempest-VolumesTestJSON-902591685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-cbbf5f0a-458f-428f-baf8-b1cd2d3e7e28 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:29 devstack sudo[86307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-cbbf5f0a-458f-428f-baf8-b1cd2d3e7e28
Feb 28 04:42:29 devstack sudo[86307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:29 devstack sudo[86301]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3a24b985-b872-4cae-82a7-90dad6965018 tempest-DeleteServersTestJSON-1600708696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-70b15ce4-8515-4a3d-82e5-db6ebabff6d0" returned: 0 in 0.422s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:29 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-3a24b985-b872-4cae-82a7-90dad6965018 tempest-DeleteServersTestJSON-1600708696 None] Lock "cinder-quobyte-70b15ce4-8515-4a3d-82e5-db6ebabff6d0" released by "delete_volume" :: held 1.196s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:42:29 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-3a24b985-b872-4cae-82a7-90dad6965018 tempest-DeleteServersTestJSON-1600708696 None] Created reservations ['4210ff39-d120-4ab7-b989-01a6bfca39e9', 'fc2ba13e-ce7e-4f05-9bef-c6d9ab354e63', '57407ca3-236b-484a-844a-11959de7819d', 'f139d715-7e54-456b-a0ed-936ddfc961c6'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:42:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3a24b985-b872-4cae-82a7-90dad6965018 tempest-DeleteServersTestJSON-1600708696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:42:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3a24b985-b872-4cae-82a7-90dad6965018 tempest-DeleteServersTestJSON-1600708696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:42:29 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-3a24b985-b872-4cae-82a7-90dad6965018 tempest-DeleteServersTestJSON-1600708696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:42:29 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-3a24b985-b872-4cae-82a7-90dad6965018 tempest-DeleteServersTestJSON-1600708696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:42:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3a24b985-b872-4cae-82a7-90dad6965018 tempest-DeleteServersTestJSON-1600708696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:42:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3a24b985-b872-4cae-82a7-90dad6965018 tempest-DeleteServersTestJSON-1600708696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:29 devstack sudo[86309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:42:29 devstack sudo[86309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:29 devstack sudo[86307]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-83f0f672-9e8f-43e5-aa6c-07e70be49a99 tempest-VolumesTestJSON-902591685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-cbbf5f0a-458f-428f-baf8-b1cd2d3e7e28" returned: 0 in 0.450s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:29 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-83f0f672-9e8f-43e5-aa6c-07e70be49a99 tempest-VolumesTestJSON-902591685 None] Lock "cinder-quobyte-cbbf5f0a-458f-428f-baf8-b1cd2d3e7e28" released by "delete_volume" :: held 0.978s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:42:29 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-83f0f672-9e8f-43e5-aa6c-07e70be49a99 tempest-VolumesTestJSON-902591685 None] Created reservations ['4b0226d4-e4f0-4595-8dbc-4d6e26119fc0', '96ed6a87-efe6-4213-9124-71ccc254ee94', 'ca2a7a75-d80d-46de-8045-7c0f09807be5', '60c24bce-0622-4bd7-8a27-65f1e42f3821'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:42:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-83f0f672-9e8f-43e5-aa6c-07e70be49a99 tempest-VolumesTestJSON-902591685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:42:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-83f0f672-9e8f-43e5-aa6c-07e70be49a99 tempest-VolumesTestJSON-902591685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:42:29 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-83f0f672-9e8f-43e5-aa6c-07e70be49a99 tempest-VolumesTestJSON-902591685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:42:29 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-83f0f672-9e8f-43e5-aa6c-07e70be49a99 tempest-VolumesTestJSON-902591685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:42:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-83f0f672-9e8f-43e5-aa6c-07e70be49a99 tempest-VolumesTestJSON-902591685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:42:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-83f0f672-9e8f-43e5-aa6c-07e70be49a99 tempest-VolumesTestJSON-902591685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:29 devstack sudo[86315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:42:29 devstack sudo[86315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:29 devstack sudo[86309]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3a24b985-b872-4cae-82a7-90dad6965018 tempest-DeleteServersTestJSON-1600708696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.495s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:29 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-3a24b985-b872-4cae-82a7-90dad6965018 tempest-DeleteServersTestJSON-1600708696 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:42:29 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-3a24b985-b872-4cae-82a7-90dad6965018 tempest-DeleteServersTestJSON-1600708696 None] Deleted volume successfully.
Feb 28 04:42:29 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-3a24b985-b872-4cae-82a7-90dad6965018 tempest-DeleteServersTestJSON-1600708696 None] Lock "cinder-70b15ce4-8515-4a3d-82e5-db6ebabff6d0-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:42:30 devstack sudo[86315]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-83f0f672-9e8f-43e5-aa6c-07e70be49a99 tempest-VolumesTestJSON-902591685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.412s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:30 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-83f0f672-9e8f-43e5-aa6c-07e70be49a99 tempest-VolumesTestJSON-902591685 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:42:30 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-83f0f672-9e8f-43e5-aa6c-07e70be49a99 tempest-VolumesTestJSON-902591685 None] Deleted volume successfully.
Feb 28 04:42:30 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-83f0f672-9e8f-43e5-aa6c-07e70be49a99 tempest-VolumesTestJSON-902591685 None] Lock "cinder-cbbf5f0a-458f-428f-baf8-b1cd2d3e7e28-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:42:31 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1e1fcd0d-1a95-499f-a999-11407cd82006 tempest-VolumesTestJSON-902591685 None] Acquiring lock "cinder-558a5580-2088-4a17-a25b-ffbf25e8e84a-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:42:31 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1e1fcd0d-1a95-499f-a999-11407cd82006 tempest-VolumesTestJSON-902591685 None] Lock "cinder-558a5580-2088-4a17-a25b-ffbf25e8e84a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:42:31 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1e1fcd0d-1a95-499f-a999-11407cd82006 tempest-VolumesTestJSON-902591685 None] Acquiring lock "cinder-quobyte-558a5580-2088-4a17-a25b-ffbf25e8e84a" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:42:31 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1e1fcd0d-1a95-499f-a999-11407cd82006 tempest-VolumesTestJSON-902591685 None] Lock "cinder-quobyte-558a5580-2088-4a17-a25b-ffbf25e8e84a" acquired by "delete_volume" :: waited 0.012s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:42:31 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[1848ef0d-3955-4fd1-b3cb-9c5d8b2f60cd]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:42:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1e1fcd0d-1a95-499f-a999-11407cd82006 tempest-VolumesTestJSON-902591685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-558a5580-2088-4a17-a25b-ffbf25e8e84a {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:31 devstack sudo[86318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-558a5580-2088-4a17-a25b-ffbf25e8e84a
Feb 28 04:42:31 devstack sudo[86318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:31 devstack sudo[86318]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1e1fcd0d-1a95-499f-a999-11407cd82006 tempest-VolumesTestJSON-902591685 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-558a5580-2088-4a17-a25b-ffbf25e8e84a" returned: 0 in 0.589s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1e1fcd0d-1a95-499f-a999-11407cd82006 tempest-VolumesTestJSON-902591685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-558a5580-2088-4a17-a25b-ffbf25e8e84a {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:31 devstack sudo[86324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-558a5580-2088-4a17-a25b-ffbf25e8e84a
Feb 28 04:42:31 devstack sudo[86324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:32 devstack sudo[86324]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1e1fcd0d-1a95-499f-a999-11407cd82006 tempest-VolumesTestJSON-902591685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-558a5580-2088-4a17-a25b-ffbf25e8e84a" returned: 0 in 0.574s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:32 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1e1fcd0d-1a95-499f-a999-11407cd82006 tempest-VolumesTestJSON-902591685 None] Lock "cinder-quobyte-558a5580-2088-4a17-a25b-ffbf25e8e84a" released by "delete_volume" :: held 1.197s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:42:32 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-1e1fcd0d-1a95-499f-a999-11407cd82006 tempest-VolumesTestJSON-902591685 None] Created reservations ['6fc563df-353d-4509-8559-6e6b9d8c2998', '7b4827e6-8d58-4032-918a-32518f26a9b7', '2df2370e-3058-476d-ad73-7256a3f1fca5', 'b8e3bddf-c480-4e97-9dfe-6fa302e986f0'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:42:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-1e1fcd0d-1a95-499f-a999-11407cd82006 tempest-VolumesTestJSON-902591685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:42:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-1e1fcd0d-1a95-499f-a999-11407cd82006 tempest-VolumesTestJSON-902591685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:42:32 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-1e1fcd0d-1a95-499f-a999-11407cd82006 tempest-VolumesTestJSON-902591685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:42:32 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-1e1fcd0d-1a95-499f-a999-11407cd82006 tempest-VolumesTestJSON-902591685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:42:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-1e1fcd0d-1a95-499f-a999-11407cd82006 tempest-VolumesTestJSON-902591685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:42:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1e1fcd0d-1a95-499f-a999-11407cd82006 tempest-VolumesTestJSON-902591685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:32 devstack sudo[86328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:42:32 devstack sudo[86328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:32 devstack sudo[86328]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1e1fcd0d-1a95-499f-a999-11407cd82006 tempest-VolumesTestJSON-902591685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.513s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:32 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-1e1fcd0d-1a95-499f-a999-11407cd82006 tempest-VolumesTestJSON-902591685 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:42:32 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-1e1fcd0d-1a95-499f-a999-11407cd82006 tempest-VolumesTestJSON-902591685 None] Deleted volume successfully.
Feb 28 04:42:32 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1e1fcd0d-1a95-499f-a999-11407cd82006 tempest-VolumesTestJSON-902591685 None] Lock "cinder-558a5580-2088-4a17-a25b-ffbf25e8e84a-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:42:35 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-5970fbbd-279c-4b4f-967d-c402733b3ab4 tempest-GroupSnapshotsTest-1988525138 None] Group tempest-GroupSnapshotsTest-Group-923694580: creating
Feb 28 04:42:35 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-5970fbbd-279c-4b4f-967d-c402733b3ab4 tempest-GroupSnapshotsTest-1988525138 None] Group tempest-GroupSnapshotsTest-Group-923694580: created successfully
Feb 28 04:42:35 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-5970fbbd-279c-4b4f-967d-c402733b3ab4 tempest-GroupSnapshotsTest-1988525138 None] Create group completed successfully.
Feb 28 04:42:37 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-8df4a39f-4398-4e8c-9f3d-8f152de89e3a tempest-GroupSnapshotsTest-1988525138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:42:37 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-8df4a39f-4398-4e8c-9f3d-8f152de89e3a tempest-GroupSnapshotsTest-1988525138 None] Flow 'volume_create_manager' (f8770dc3-f2d8-4378-aff5-7b6b52b803e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:42:37 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-8df4a39f-4398-4e8c-9f3d-8f152de89e3a tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d5ada1-659f-4a88-b443-41d800384173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:37 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-8df4a39f-4398-4e8c-9f3d-8f152de89e3a tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d5ada1-659f-4a88-b443-41d800384173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-397586236',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5e408dd4-5524-4797-a054-96adbea1cf78,host='devstack@QuobyteHD#QuobyteHD',id=3c20ec3c-29da-4769-a49c-300e09f32fdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e1e121bb1f4469b9c38572b5eafe4ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:42:37Z,use_quota=True,user_id='ce45ee3e0a5848dea508be3d13e513bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8baa816e-1910-42f4-9db2-16a732b8f90e),volume_type_id=8baa816e-1910-42f4-9db2-16a732b8f90e)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:42:37 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-8df4a39f-4398-4e8c-9f3d-8f152de89e3a tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5ff3ed1-8a07-4824-ad43-20d7c5e973a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:37 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-8df4a39f-4398-4e8c-9f3d-8f152de89e3a tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5ff3ed1-8a07-4824-ad43-20d7c5e973a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:42:37 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-8df4a39f-4398-4e8c-9f3d-8f152de89e3a tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee86e1d5-b605-4042-9903-84ae3be09f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:37 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-8df4a39f-4398-4e8c-9f3d-8f152de89e3a tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee86e1d5-b605-4042-9903-84ae3be09f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c20ec3c-29da-4769-a49c-300e09f32fdc', 'volume_name': 'volume-3c20ec3c-29da-4769-a49c-300e09f32fdc', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:42:37 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-8df4a39f-4398-4e8c-9f3d-8f152de89e3a tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e970f47-e8e4-4033-9cc1-41f01ec5991e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:37 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-8df4a39f-4398-4e8c-9f3d-8f152de89e3a tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e970f47-e8e4-4033-9cc1-41f01ec5991e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:42:37 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-8df4a39f-4398-4e8c-9f3d-8f152de89e3a tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c529c81-48a3-46fe-92db-2c0706458e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:37 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-8df4a39f-4398-4e8c-9f3d-8f152de89e3a tempest-GroupSnapshotsTest-1988525138 None] Volume 3c20ec3c-29da-4769-a49c-300e09f32fdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c20ec3c-29da-4769-a49c-300e09f32fdc', 'volume_size': 1}
Feb 28 04:42:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-8df4a39f-4398-4e8c-9f3d-8f152de89e3a tempest-GroupSnapshotsTest-1988525138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:42:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-8df4a39f-4398-4e8c-9f3d-8f152de89e3a tempest-GroupSnapshotsTest-1988525138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:42:37 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-8df4a39f-4398-4e8c-9f3d-8f152de89e3a tempest-GroupSnapshotsTest-1988525138 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=5e408dd4-5524-4797-a054-96adbea1cf78,created_at=2026-02-28T03:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-397586236',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5e408dd4-5524-4797-a054-96adbea1cf78,host='devstack@QuobyteHD#QuobyteHD',id=3c20ec3c-29da-4769-a49c-300e09f32fdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e1e121bb1f4469b9c38572b5eafe4ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:42:37Z,use_quota=True,user_id='ce45ee3e0a5848dea508be3d13e513bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8baa816e-1910-42f4-9db2-16a732b8f90e),volume_type_id=8baa816e-1910-42f4-9db2-16a732b8f90e)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:42:37 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-8df4a39f-4398-4e8c-9f3d-8f152de89e3a tempest-GroupSnapshotsTest-1988525138 None] Creating volume 3c20ec3c-29da-4769-a49c-300e09f32fdc {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:42:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-8df4a39f-4398-4e8c-9f3d-8f152de89e3a tempest-GroupSnapshotsTest-1988525138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:42:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-8df4a39f-4398-4e8c-9f3d-8f152de89e3a tempest-GroupSnapshotsTest-1988525138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:42:37 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-8df4a39f-4398-4e8c-9f3d-8f152de89e3a tempest-GroupSnapshotsTest-1988525138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:42:37 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-8df4a39f-4398-4e8c-9f3d-8f152de89e3a tempest-GroupSnapshotsTest-1988525138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:42:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-8df4a39f-4398-4e8c-9f3d-8f152de89e3a tempest-GroupSnapshotsTest-1988525138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:42:37 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-8df4a39f-4398-4e8c-9f3d-8f152de89e3a tempest-GroupSnapshotsTest-1988525138 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:42:37 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-8df4a39f-4398-4e8c-9f3d-8f152de89e3a tempest-GroupSnapshotsTest-1988525138 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:42:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8df4a39f-4398-4e8c-9f3d-8f152de89e3a tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:37 devstack sudo[86377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc 1073741824
Feb 28 04:42:37 devstack sudo[86377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:38 devstack sudo[86377]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8df4a39f-4398-4e8c-9f3d-8f152de89e3a tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc 1073741824" returned: 0 in 0.955s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8df4a39f-4398-4e8c-9f3d-8f152de89e3a tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:38 devstack sudo[86385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc
Feb 28 04:42:38 devstack sudo[86385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:38 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-35a93aea-73d2-4565-822d-5a3301a6939a tempest-GroupsV320Test-1575778508 None] Group tempest-GroupsV320Test-Group-2069161700: creating
Feb 28 04:42:38 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-35a93aea-73d2-4565-822d-5a3301a6939a tempest-GroupsV320Test-1575778508 None] Group tempest-GroupsV320Test-Group-2069161700: created successfully
Feb 28 04:42:38 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-35a93aea-73d2-4565-822d-5a3301a6939a tempest-GroupsV320Test-1575778508 None] Create group completed successfully.
Feb 28 04:42:39 devstack sudo[86385]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8df4a39f-4398-4e8c-9f3d-8f152de89e3a tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc" returned: 0 in 0.741s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:39 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-8df4a39f-4398-4e8c-9f3d-8f152de89e3a tempest-GroupSnapshotsTest-1988525138 None] <== create_volume: return (1756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:42:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-8df4a39f-4398-4e8c-9f3d-8f152de89e3a tempest-GroupSnapshotsTest-1988525138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.758s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:42:39 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-8df4a39f-4398-4e8c-9f3d-8f152de89e3a tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c529c81-48a3-46fe-92db-2c0706458e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c20ec3c-29da-4769-a49c-300e09f32fdc', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:42:39 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-8df4a39f-4398-4e8c-9f3d-8f152de89e3a tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (619869c7-cb04-41fb-8d96-17661762e9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:39 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-8df4a39f-4398-4e8c-9f3d-8f152de89e3a tempest-GroupSnapshotsTest-1988525138 None] Volume volume-3c20ec3c-29da-4769-a49c-300e09f32fdc (3c20ec3c-29da-4769-a49c-300e09f32fdc): created successfully
Feb 28 04:42:39 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-8df4a39f-4398-4e8c-9f3d-8f152de89e3a tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (619869c7-cb04-41fb-8d96-17661762e9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:42:39 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-8df4a39f-4398-4e8c-9f3d-8f152de89e3a tempest-GroupSnapshotsTest-1988525138 None] Flow 'volume_create_manager' (f8770dc3-f2d8-4378-aff5-7b6b52b803e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:42:39 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-8df4a39f-4398-4e8c-9f3d-8f152de89e3a tempest-GroupSnapshotsTest-1988525138 None] Created volume successfully.
Feb 28 04:42:39 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-fbe09e6a-6aa3-4ef7-a932-8a3a84274628 tempest-GroupSnapshotsTest-1988525138 None] GroupSnapshot c13cb783-9698-4074-91d1-e3517a99ca1c: creating.
Feb 28 04:42:39 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-fbe09e6a-6aa3-4ef7-a932-8a3a84274628 tempest-GroupSnapshotsTest-1988525138 None] Group snapshot c13cb783-9698-4074-91d1-e3517a99ca1c: creating. {{(pid=84248) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Feb 28 04:42:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-fbe09e6a-6aa3-4ef7-a932-8a3a84274628 tempest-GroupSnapshotsTest-1988525138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:42:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-fbe09e6a-6aa3-4ef7-a932-8a3a84274628 tempest-GroupSnapshotsTest-1988525138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:42:39 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-fbe09e6a-6aa3-4ef7-a932-8a3a84274628 tempest-GroupSnapshotsTest-1988525138 None] Creating offline snapshot af7d6f27-ece8-454c-b075-5180bd4e1760 of volume 3c20ec3c-29da-4769-a49c-300e09f32fdc {{(pid=84248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 04:42:39 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[c149d402-b385-4c74-8f7f-2b8a7d9fe034]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:42:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-fbe09e6a-6aa3-4ef7-a932-8a3a84274628 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:39 devstack sudo[86389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc
Feb 28 04:42:39 devstack sudo[86389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:40 devstack sudo[86389]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-fbe09e6a-6aa3-4ef7-a932-8a3a84274628 tempest-GroupSnapshotsTest-1988525138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc" returned: 0 in 0.609s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-fbe09e6a-6aa3-4ef7-a932-8a3a84274628 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc.af7d6f27-ece8-454c-b075-5180bd4e1760 1G {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:40 devstack sudo[86394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc.af7d6f27-ece8-454c-b075-5180bd4e1760 1G
Feb 28 04:42:40 devstack sudo[86394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:40 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-e071c95a-68dd-4bc9-95a3-b42293aa987d tempest-GroupsV320Test-1575778508 None] Created reservations ['7aea3885-e598-45fe-95b0-8b4073e6f1ba'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:42:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e071c95a-68dd-4bc9-95a3-b42293aa987d tempest-GroupsV320Test-1575778508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:42:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e071c95a-68dd-4bc9-95a3-b42293aa987d tempest-GroupsV320Test-1575778508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:42:40 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-e071c95a-68dd-4bc9-95a3-b42293aa987d tempest-GroupsV320Test-1575778508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:42:40 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-e071c95a-68dd-4bc9-95a3-b42293aa987d tempest-GroupsV320Test-1575778508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:42:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e071c95a-68dd-4bc9-95a3-b42293aa987d tempest-GroupsV320Test-1575778508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:42:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e071c95a-68dd-4bc9-95a3-b42293aa987d tempest-GroupsV320Test-1575778508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:40 devstack sudo[86396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:42:40 devstack sudo[86396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:40 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [req-5aecfa70-458c-4dfd-ab24-afe2e767db34 req-6bcebf13-7207-4b77-9621-81dc66e29e5a tempest-VolumesSnapshotsTestJSON-1400729173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:42:40 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-5aecfa70-458c-4dfd-ab24-afe2e767db34 req-6bcebf13-7207-4b77-9621-81dc66e29e5a tempest-VolumesSnapshotsTestJSON-1400729173 None] Flow 'volume_create_manager' (8eecec25-1ae9-44f2-afc1-78882441d51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:42:40 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-5aecfa70-458c-4dfd-ab24-afe2e767db34 req-6bcebf13-7207-4b77-9621-81dc66e29e5a tempest-VolumesSnapshotsTestJSON-1400729173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6d2f5df-53fe-49be-8508-913a3f2e7112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:40 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-5aecfa70-458c-4dfd-ab24-afe2e767db34 req-6bcebf13-7207-4b77-9621-81dc66e29e5a tempest-VolumesSnapshotsTestJSON-1400729173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6d2f5df-53fe-49be-8508-913a3f2e7112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1431751238',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12bb03cd-b594-4546-83a7-dceae69971f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='317bf94a80204569b36ac1ffacf93a87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:42:41Z,use_quota=True,user_id='0b5ef146e9044c5f9318173336fc945c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:42:40 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-5aecfa70-458c-4dfd-ab24-afe2e767db34 req-6bcebf13-7207-4b77-9621-81dc66e29e5a tempest-VolumesSnapshotsTestJSON-1400729173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8b99659-400d-41bd-ad54-e245600f8c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:40 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-5aecfa70-458c-4dfd-ab24-afe2e767db34 req-6bcebf13-7207-4b77-9621-81dc66e29e5a tempest-VolumesSnapshotsTestJSON-1400729173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8b99659-400d-41bd-ad54-e245600f8c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:42:40 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-5aecfa70-458c-4dfd-ab24-afe2e767db34 req-6bcebf13-7207-4b77-9621-81dc66e29e5a tempest-VolumesSnapshotsTestJSON-1400729173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbf293d9-0655-42f9-b670-7744b09bb601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:40 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-5aecfa70-458c-4dfd-ab24-afe2e767db34 req-6bcebf13-7207-4b77-9621-81dc66e29e5a tempest-VolumesSnapshotsTestJSON-1400729173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbf293d9-0655-42f9-b670-7744b09bb601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12bb03cd-b594-4546-83a7-dceae69971f4', 'volume_name': 'volume-12bb03cd-b594-4546-83a7-dceae69971f4', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:42:40 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-5aecfa70-458c-4dfd-ab24-afe2e767db34 req-6bcebf13-7207-4b77-9621-81dc66e29e5a tempest-VolumesSnapshotsTestJSON-1400729173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d8d43c3-0531-42ba-bb53-702619f14827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:40 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-5aecfa70-458c-4dfd-ab24-afe2e767db34 req-6bcebf13-7207-4b77-9621-81dc66e29e5a tempest-VolumesSnapshotsTestJSON-1400729173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d8d43c3-0531-42ba-bb53-702619f14827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:42:40 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-5aecfa70-458c-4dfd-ab24-afe2e767db34 req-6bcebf13-7207-4b77-9621-81dc66e29e5a tempest-VolumesSnapshotsTestJSON-1400729173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff4cebd7-5cb1-4fd1-a09c-f62e55e6c15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:40 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [req-5aecfa70-458c-4dfd-ab24-afe2e767db34 req-6bcebf13-7207-4b77-9621-81dc66e29e5a tempest-VolumesSnapshotsTestJSON-1400729173 None] Volume 12bb03cd-b594-4546-83a7-dceae69971f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12bb03cd-b594-4546-83a7-dceae69971f4', 'volume_size': 1}
Feb 28 04:42:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-5aecfa70-458c-4dfd-ab24-afe2e767db34 req-6bcebf13-7207-4b77-9621-81dc66e29e5a tempest-VolumesSnapshotsTestJSON-1400729173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:42:41 devstack sudo[86394]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-fbe09e6a-6aa3-4ef7-a932-8a3a84274628 tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc.af7d6f27-ece8-454c-b075-5180bd4e1760 1G" returned: 0 in 0.640s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-fbe09e6a-6aa3-4ef7-a932-8a3a84274628 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c20ec3c-29da-4769-a49c-300e09f32fdc -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc.af7d6f27-ece8-454c-b075-5180bd4e1760 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:41 devstack sudo[86402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c20ec3c-29da-4769-a49c-300e09f32fdc -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc.af7d6f27-ece8-454c-b075-5180bd4e1760
Feb 28 04:42:41 devstack sudo[86402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:41 devstack sudo[86396]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e071c95a-68dd-4bc9-95a3-b42293aa987d tempest-GroupsV320Test-1575778508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.494s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:41 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-e071c95a-68dd-4bc9-95a3-b42293aa987d tempest-GroupsV320Test-1575778508 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:42:41 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-e071c95a-68dd-4bc9-95a3-b42293aa987d tempest-GroupsV320Test-1575778508 None] Delete group completed successfully.
Feb 28 04:42:41 devstack sudo[86402]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-fbe09e6a-6aa3-4ef7-a932-8a3a84274628 tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c20ec3c-29da-4769-a49c-300e09f32fdc -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc.af7d6f27-ece8-454c-b075-5180bd4e1760" returned: 0 in 0.414s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:41 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-fbe09e6a-6aa3-4ef7-a932-8a3a84274628 tempest-GroupSnapshotsTest-1988525138 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc.af7d6f27-ece8-454c-b075-5180bd4e1760 is being set with open permissions: ugo+rw: NotImplementedError
Feb 28 04:42:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-fbe09e6a-6aa3-4ef7-a932-8a3a84274628 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc.af7d6f27-ece8-454c-b075-5180bd4e1760 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:41 devstack sudo[86407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc.af7d6f27-ece8-454c-b075-5180bd4e1760
Feb 28 04:42:41 devstack sudo[86407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:41 devstack sudo[86407]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-fbe09e6a-6aa3-4ef7-a932-8a3a84274628 tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc.af7d6f27-ece8-454c-b075-5180bd4e1760" returned: 0 in 0.471s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-fbe09e6a-6aa3-4ef7-a932-8a3a84274628 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:41 devstack sudo[86410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc.info
Feb 28 04:42:41 devstack sudo[86410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:42 devstack sudo[86410]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:42 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-fbe09e6a-6aa3-4ef7-a932-8a3a84274628 tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc.info" returned: 0 in 0.484s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:42 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-fbe09e6a-6aa3-4ef7-a932-8a3a84274628 tempest-GroupSnapshotsTest-1988525138 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc.info is being set with open permissions: ugo+rw: NotImplementedError
Feb 28 04:42:42 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-fbe09e6a-6aa3-4ef7-a932-8a3a84274628 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:42 devstack sudo[86413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc.info
Feb 28 04:42:42 devstack sudo[86413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:42 devstack sudo[86413]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:42 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-fbe09e6a-6aa3-4ef7-a932-8a3a84274628 tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc.info" returned: 0 in 0.475s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:42 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-fbe09e6a-6aa3-4ef7-a932-8a3a84274628 tempest-GroupSnapshotsTest-1988525138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.164s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:42:42 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-5aecfa70-458c-4dfd-ab24-afe2e767db34 req-6bcebf13-7207-4b77-9621-81dc66e29e5a tempest-VolumesSnapshotsTestJSON-1400729173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.136s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:42:42 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [req-5aecfa70-458c-4dfd-ab24-afe2e767db34 req-6bcebf13-7207-4b77-9621-81dc66e29e5a tempest-VolumesSnapshotsTestJSON-1400729173 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1431751238',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12bb03cd-b594-4546-83a7-dceae69971f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='317bf94a80204569b36ac1ffacf93a87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:42:41Z,use_quota=True,user_id='0b5ef146e9044c5f9318173336fc945c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:42:42 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [req-5aecfa70-458c-4dfd-ab24-afe2e767db34 req-6bcebf13-7207-4b77-9621-81dc66e29e5a tempest-VolumesSnapshotsTestJSON-1400729173 None] Creating volume 12bb03cd-b594-4546-83a7-dceae69971f4 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:42:42 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-5aecfa70-458c-4dfd-ab24-afe2e767db34 req-6bcebf13-7207-4b77-9621-81dc66e29e5a tempest-VolumesSnapshotsTestJSON-1400729173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:42:42 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-5aecfa70-458c-4dfd-ab24-afe2e767db34 req-6bcebf13-7207-4b77-9621-81dc66e29e5a tempest-VolumesSnapshotsTestJSON-1400729173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:42:42 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [req-5aecfa70-458c-4dfd-ab24-afe2e767db34 req-6bcebf13-7207-4b77-9621-81dc66e29e5a tempest-VolumesSnapshotsTestJSON-1400729173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:42:42 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [req-5aecfa70-458c-4dfd-ab24-afe2e767db34 req-6bcebf13-7207-4b77-9621-81dc66e29e5a tempest-VolumesSnapshotsTestJSON-1400729173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:42:42 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-5aecfa70-458c-4dfd-ab24-afe2e767db34 req-6bcebf13-7207-4b77-9621-81dc66e29e5a tempest-VolumesSnapshotsTestJSON-1400729173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:42:42 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [req-5aecfa70-458c-4dfd-ab24-afe2e767db34 req-6bcebf13-7207-4b77-9621-81dc66e29e5a tempest-VolumesSnapshotsTestJSON-1400729173 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:42:42 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [req-5aecfa70-458c-4dfd-ab24-afe2e767db34 req-6bcebf13-7207-4b77-9621-81dc66e29e5a tempest-VolumesSnapshotsTestJSON-1400729173 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:42:42 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-5aecfa70-458c-4dfd-ab24-afe2e767db34 req-6bcebf13-7207-4b77-9621-81dc66e29e5a tempest-VolumesSnapshotsTestJSON-1400729173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:42 devstack sudo[86416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4 1073741824
Feb 28 04:42:42 devstack sudo[86416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:43 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-fbe09e6a-6aa3-4ef7-a932-8a3a84274628 tempest-GroupSnapshotsTest-1988525138 None] group_snapshot c13cb783-9698-4074-91d1-e3517a99ca1c: created successfully
Feb 28 04:42:43 devstack sudo[86416]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:43 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-5aecfa70-458c-4dfd-ab24-afe2e767db34 req-6bcebf13-7207-4b77-9621-81dc66e29e5a tempest-VolumesSnapshotsTestJSON-1400729173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4 1073741824" returned: 0 in 0.599s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:43 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-5aecfa70-458c-4dfd-ab24-afe2e767db34 req-6bcebf13-7207-4b77-9621-81dc66e29e5a tempest-VolumesSnapshotsTestJSON-1400729173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:43 devstack sudo[86421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4
Feb 28 04:42:43 devstack sudo[86421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:44 devstack sudo[86421]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-5aecfa70-458c-4dfd-ab24-afe2e767db34 req-6bcebf13-7207-4b77-9621-81dc66e29e5a tempest-VolumesSnapshotsTestJSON-1400729173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4" returned: 0 in 0.580s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:44 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [req-5aecfa70-458c-4dfd-ab24-afe2e767db34 req-6bcebf13-7207-4b77-9621-81dc66e29e5a tempest-VolumesSnapshotsTestJSON-1400729173 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:42:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-5aecfa70-458c-4dfd-ab24-afe2e767db34 req-6bcebf13-7207-4b77-9621-81dc66e29e5a tempest-VolumesSnapshotsTestJSON-1400729173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:42:44 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-5aecfa70-458c-4dfd-ab24-afe2e767db34 req-6bcebf13-7207-4b77-9621-81dc66e29e5a tempest-VolumesSnapshotsTestJSON-1400729173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff4cebd7-5cb1-4fd1-a09c-f62e55e6c15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12bb03cd-b594-4546-83a7-dceae69971f4', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:42:44 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-5aecfa70-458c-4dfd-ab24-afe2e767db34 req-6bcebf13-7207-4b77-9621-81dc66e29e5a tempest-VolumesSnapshotsTestJSON-1400729173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d05de5a5-1481-496a-9da0-38fa5e0c3c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:44 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [req-5aecfa70-458c-4dfd-ab24-afe2e767db34 req-6bcebf13-7207-4b77-9621-81dc66e29e5a tempest-VolumesSnapshotsTestJSON-1400729173 None] Volume volume-12bb03cd-b594-4546-83a7-dceae69971f4 (12bb03cd-b594-4546-83a7-dceae69971f4): created successfully
Feb 28 04:42:44 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-5aecfa70-458c-4dfd-ab24-afe2e767db34 req-6bcebf13-7207-4b77-9621-81dc66e29e5a tempest-VolumesSnapshotsTestJSON-1400729173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d05de5a5-1481-496a-9da0-38fa5e0c3c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:42:44 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-5aecfa70-458c-4dfd-ab24-afe2e767db34 req-6bcebf13-7207-4b77-9621-81dc66e29e5a tempest-VolumesSnapshotsTestJSON-1400729173 None] Flow 'volume_create_manager' (8eecec25-1ae9-44f2-afc1-78882441d51f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:42:44 devstack cinder-volume[84248]: INFO cinder.volume.manager [req-5aecfa70-458c-4dfd-ab24-afe2e767db34 req-6bcebf13-7207-4b77-9621-81dc66e29e5a tempest-VolumesSnapshotsTestJSON-1400729173 None] Created volume successfully.
Feb 28 04:42:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-1b1629af-3c62-48a2-b3aa-cc223a0bf685 tempest-GroupSnapshotsTest-1988525138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:42:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-1b1629af-3c62-48a2-b3aa-cc223a0bf685 tempest-GroupSnapshotsTest-1988525138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:42:45 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1b1629af-3c62-48a2-b3aa-cc223a0bf685 tempest-GroupSnapshotsTest-1988525138 None] Acquiring lock "cinder-quobyte-af7d6f27-ece8-454c-b075-5180bd4e1760-716bb927-928e-4eec-b158-1cc6807233d0" by "_create_volume_from_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:42:45 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1b1629af-3c62-48a2-b3aa-cc223a0bf685 tempest-GroupSnapshotsTest-1988525138 None] Lock "cinder-quobyte-af7d6f27-ece8-454c-b075-5180bd4e1760-716bb927-928e-4eec-b158-1cc6807233d0" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:42:45 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-1b1629af-3c62-48a2-b3aa-cc223a0bf685 tempest-GroupSnapshotsTest-1988525138 None] Creating volume 716bb927-928e-4eec-b158-1cc6807233d0 from snapshot af7d6f27-ece8-454c-b075-5180bd4e1760 {{(pid=84248) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Feb 28 04:42:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-1b1629af-3c62-48a2-b3aa-cc223a0bf685 tempest-GroupSnapshotsTest-1988525138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:42:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-1b1629af-3c62-48a2-b3aa-cc223a0bf685 tempest-GroupSnapshotsTest-1988525138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:42:45 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-1b1629af-3c62-48a2-b3aa-cc223a0bf685 tempest-GroupSnapshotsTest-1988525138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:42:45 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-1b1629af-3c62-48a2-b3aa-cc223a0bf685 tempest-GroupSnapshotsTest-1988525138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:42:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-1b1629af-3c62-48a2-b3aa-cc223a0bf685 tempest-GroupSnapshotsTest-1988525138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:42:45 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-1b1629af-3c62-48a2-b3aa-cc223a0bf685 tempest-GroupSnapshotsTest-1988525138 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:42:45 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1b1629af-3c62-48a2-b3aa-cc223a0bf685 tempest-GroupSnapshotsTest-1988525138 None] Acquiring lock "cinder-quobyte-716bb927-928e-4eec-b158-1cc6807233d0" by "_copy_volume_from_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:42:45 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1b1629af-3c62-48a2-b3aa-cc223a0bf685 tempest-GroupSnapshotsTest-1988525138 None] Lock "cinder-quobyte-716bb927-928e-4eec-b158-1cc6807233d0" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:42:45 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-1b1629af-3c62-48a2-b3aa-cc223a0bf685 tempest-GroupSnapshotsTest-1988525138 None] snapshot: af7d6f27-ece8-454c-b075-5180bd4e1760, volume: 716bb927-928e-4eec-b158-1cc6807233d0,  {{(pid=84248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 28 04:42:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-1b1629af-3c62-48a2-b3aa-cc223a0bf685 tempest-GroupSnapshotsTest-1988525138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:42:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-1b1629af-3c62-48a2-b3aa-cc223a0bf685 tempest-GroupSnapshotsTest-1988525138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:42:45 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-1b1629af-3c62-48a2-b3aa-cc223a0bf685 tempest-GroupSnapshotsTest-1988525138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:42:45 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-1b1629af-3c62-48a2-b3aa-cc223a0bf685 tempest-GroupSnapshotsTest-1988525138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:42:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-1b1629af-3c62-48a2-b3aa-cc223a0bf685 tempest-GroupSnapshotsTest-1988525138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:42:45 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd6e9b9-ad76-4d52-a046-3386dcb56eb5]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:42:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1b1629af-3c62-48a2-b3aa-cc223a0bf685 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc.af7d6f27-ece8-454c-b075-5180bd4e1760 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:45 devstack sudo[86446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc.af7d6f27-ece8-454c-b075-5180bd4e1760
Feb 28 04:42:45 devstack sudo[86446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:45 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ce414ce-ca46-4409-a2fb-e1139afcf1e1 tempest-SnapshotsActionsTest-1355677458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:42:45 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6ce414ce-ca46-4409-a2fb-e1139afcf1e1 tempest-SnapshotsActionsTest-1355677458 None] Flow 'volume_create_manager' (84390303-eb60-4079-9c3b-7d8ebc52fd85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:42:45 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6ce414ce-ca46-4409-a2fb-e1139afcf1e1 tempest-SnapshotsActionsTest-1355677458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3142628-5ee2-4963-87ab-14b5c954ad7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:45 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6ce414ce-ca46-4409-a2fb-e1139afcf1e1 tempest-SnapshotsActionsTest-1355677458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3142628-5ee2-4963-87ab-14b5c954ad7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-616662279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a27a465-7230-4e68-9540-285c134cf1c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f05ac06db0b4ffa87cb6d6b8ec1b872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:42:45Z,use_quota=True,user_id='844e0f6d48e24f3c8cc45c0a353b82a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:42:45 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6ce414ce-ca46-4409-a2fb-e1139afcf1e1 tempest-SnapshotsActionsTest-1355677458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (082f092c-c1e3-45c8-a368-4ead26568973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:45 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6ce414ce-ca46-4409-a2fb-e1139afcf1e1 tempest-SnapshotsActionsTest-1355677458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (082f092c-c1e3-45c8-a368-4ead26568973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:42:45 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6ce414ce-ca46-4409-a2fb-e1139afcf1e1 tempest-SnapshotsActionsTest-1355677458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (392d964a-0020-4a74-bcb3-29cce1375c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:45 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6ce414ce-ca46-4409-a2fb-e1139afcf1e1 tempest-SnapshotsActionsTest-1355677458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (392d964a-0020-4a74-bcb3-29cce1375c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a27a465-7230-4e68-9540-285c134cf1c5', 'volume_name': 'volume-0a27a465-7230-4e68-9540-285c134cf1c5', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:42:45 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6ce414ce-ca46-4409-a2fb-e1139afcf1e1 tempest-SnapshotsActionsTest-1355677458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9972a7b0-45b4-4e1a-8be3-325a7f040340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:45 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6ce414ce-ca46-4409-a2fb-e1139afcf1e1 tempest-SnapshotsActionsTest-1355677458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9972a7b0-45b4-4e1a-8be3-325a7f040340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:42:45 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6ce414ce-ca46-4409-a2fb-e1139afcf1e1 tempest-SnapshotsActionsTest-1355677458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (813fc3a2-1924-4e38-b8a7-00acc2cfe167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:45 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-6ce414ce-ca46-4409-a2fb-e1139afcf1e1 tempest-SnapshotsActionsTest-1355677458 None] Volume 0a27a465-7230-4e68-9540-285c134cf1c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a27a465-7230-4e68-9540-285c134cf1c5', 'volume_size': 1}
Feb 28 04:42:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-6ce414ce-ca46-4409-a2fb-e1139afcf1e1 tempest-SnapshotsActionsTest-1355677458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:42:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-cf0900a0-6a6d-493b-91bc-4d9b3f7d0ddc req-9b101931-340e-43c5-94c4-fd57350332e6 tempest-VolumesSnapshotsTestJSON-1400729173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:42:45 devstack sudo[86446]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1b1629af-3c62-48a2-b3aa-cc223a0bf685 tempest-GroupSnapshotsTest-1988525138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc.af7d6f27-ece8-454c-b075-5180bd4e1760" returned: 0 in 0.686s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:45 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-1b1629af-3c62-48a2-b3aa-cc223a0bf685 tempest-GroupSnapshotsTest-1988525138 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c20ec3c-29da-4769-a49c-300e09f32fdc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:42:45 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-1b1629af-3c62-48a2-b3aa-cc223a0bf685 tempest-GroupSnapshotsTest-1988525138 None] will copy from snapshot at /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc {{(pid=84248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 28 04:42:45 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-1b1629af-3c62-48a2-b3aa-cc223a0bf685 tempest-GroupSnapshotsTest-1988525138 None] Creating direct copy from snapshot {{(pid=84248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 28 04:42:45 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[009aa295-692d-4284-86d5-c823b72654d3]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:42:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1b1629af-3c62-48a2-b3aa-cc223a0bf685 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:46 devstack sudo[86451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc
Feb 28 04:42:46 devstack sudo[86451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:46 devstack sudo[86451]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:46 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1b1629af-3c62-48a2-b3aa-cc223a0bf685 tempest-GroupSnapshotsTest-1988525138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc" returned: 0 in 0.510s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:46 devstack cinder-volume[84248]: DEBUG cinder.utils [None req-1b1629af-3c62-48a2-b3aa-cc223a0bf685 tempest-GroupSnapshotsTest-1988525138 None] Path /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-716bb927-928e-4eec-b158-1cc6807233d0 not found in is_blk_device check {{(pid=84248) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 28 04:42:46 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1b1629af-3c62-48a2-b3aa-cc223a0bf685 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-716bb927-928e-4eec-b158-1cc6807233d0 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:46 devstack sudo[86456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-716bb927-928e-4eec-b158-1cc6807233d0
Feb 28 04:42:46 devstack sudo[86456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:49 devstack sudo[86456]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1b1629af-3c62-48a2-b3aa-cc223a0bf685 tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-716bb927-928e-4eec-b158-1cc6807233d0" returned: 0 in 2.922s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:49 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[735b633f-4ce8-4447-ad07-3879d6f77466]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:42:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1b1629af-3c62-48a2-b3aa-cc223a0bf685 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:49 devstack sudo[86485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc
Feb 28 04:42:49 devstack sudo[86485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:49 devstack sudo[86485]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1b1629af-3c62-48a2-b3aa-cc223a0bf685 tempest-GroupSnapshotsTest-1988525138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc" returned: 0 in 0.606s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:49 devstack cinder-volume[84248]: DEBUG cinder.image.image_utils [None req-1b1629af-3c62-48a2-b3aa-cc223a0bf685 tempest-GroupSnapshotsTest-1988525138 None] Image conversion details: src /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc, size 1024.00 MB, duration 2.92 sec, destination /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-716bb927-928e-4eec-b158-1cc6807233d0 {{(pid=84248) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 28 04:42:49 devstack cinder-volume[84248]: INFO cinder.image.image_utils [None req-1b1629af-3c62-48a2-b3aa-cc223a0bf685 tempest-GroupSnapshotsTest-1988525138 None] Converted 1024.00 MB image at 350.31 MB/s
Feb 28 04:42:49 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-1b1629af-3c62-48a2-b3aa-cc223a0bf685 tempest-GroupSnapshotsTest-1988525138 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-716bb927-928e-4eec-b158-1cc6807233d0 is being set with open permissions: ugo+rw: NotImplementedError
Feb 28 04:42:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1b1629af-3c62-48a2-b3aa-cc223a0bf685 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-716bb927-928e-4eec-b158-1cc6807233d0 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:49 devstack sudo[86508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-716bb927-928e-4eec-b158-1cc6807233d0
Feb 28 04:42:49 devstack sudo[86508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:50 devstack sudo[86508]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1b1629af-3c62-48a2-b3aa-cc223a0bf685 tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-716bb927-928e-4eec-b158-1cc6807233d0" returned: 0 in 0.405s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:50 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1b1629af-3c62-48a2-b3aa-cc223a0bf685 tempest-GroupSnapshotsTest-1988525138 None] Lock "cinder-quobyte-716bb927-928e-4eec-b158-1cc6807233d0" released by "_copy_volume_from_snapshot" :: held 5.233s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:42:50 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1b1629af-3c62-48a2-b3aa-cc223a0bf685 tempest-GroupSnapshotsTest-1988525138 None] Lock "cinder-quobyte-af7d6f27-ece8-454c-b075-5180bd4e1760-716bb927-928e-4eec-b158-1cc6807233d0" released by "_create_volume_from_snapshot" :: held 5.274s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:42:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-1b1629af-3c62-48a2-b3aa-cc223a0bf685 tempest-GroupSnapshotsTest-1988525138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.288s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:42:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-6ce414ce-ca46-4409-a2fb-e1139afcf1e1 tempest-SnapshotsActionsTest-1355677458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.880s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:42:50 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-6ce414ce-ca46-4409-a2fb-e1139afcf1e1 tempest-SnapshotsActionsTest-1355677458 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-616662279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a27a465-7230-4e68-9540-285c134cf1c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f05ac06db0b4ffa87cb6d6b8ec1b872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:42:45Z,use_quota=True,user_id='844e0f6d48e24f3c8cc45c0a353b82a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:42:50 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-6ce414ce-ca46-4409-a2fb-e1139afcf1e1 tempest-SnapshotsActionsTest-1355677458 None] Creating volume 0a27a465-7230-4e68-9540-285c134cf1c5 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:42:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-6ce414ce-ca46-4409-a2fb-e1139afcf1e1 tempest-SnapshotsActionsTest-1355677458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:42:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-6ce414ce-ca46-4409-a2fb-e1139afcf1e1 tempest-SnapshotsActionsTest-1355677458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:42:50 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-6ce414ce-ca46-4409-a2fb-e1139afcf1e1 tempest-SnapshotsActionsTest-1355677458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:42:50 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-6ce414ce-ca46-4409-a2fb-e1139afcf1e1 tempest-SnapshotsActionsTest-1355677458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:42:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-6ce414ce-ca46-4409-a2fb-e1139afcf1e1 tempest-SnapshotsActionsTest-1355677458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:42:50 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-6ce414ce-ca46-4409-a2fb-e1139afcf1e1 tempest-SnapshotsActionsTest-1355677458 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:42:50 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-6ce414ce-ca46-4409-a2fb-e1139afcf1e1 tempest-SnapshotsActionsTest-1355677458 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:42:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6ce414ce-ca46-4409-a2fb-e1139afcf1e1 tempest-SnapshotsActionsTest-1355677458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:50 devstack sudo[86511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5 1073741824
Feb 28 04:42:50 devstack sudo[86511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:50 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-1b1629af-3c62-48a2-b3aa-cc223a0bf685 tempest-GroupSnapshotsTest-1988525138 None] Create group from source-snapshot-c13cb783-9698-4074-91d1-e3517a99ca1c completed successfully.
Feb 28 04:42:50 devstack sudo[86511]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6ce414ce-ca46-4409-a2fb-e1139afcf1e1 tempest-SnapshotsActionsTest-1355677458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5 1073741824" returned: 0 in 0.552s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6ce414ce-ca46-4409-a2fb-e1139afcf1e1 tempest-SnapshotsActionsTest-1355677458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:51 devstack sudo[86516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5
Feb 28 04:42:51 devstack sudo[86516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:51 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-38d1595d-08ca-4a3f-ac58-11de6ade11ce tempest-GroupSnapshotsTest-1988525138 None] Acquiring lock "cinder-quobyte-716bb927-928e-4eec-b158-1cc6807233d0" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:42:51 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-38d1595d-08ca-4a3f-ac58-11de6ade11ce tempest-GroupSnapshotsTest-1988525138 None] Lock "cinder-quobyte-716bb927-928e-4eec-b158-1cc6807233d0" acquired by "delete_volume" :: waited 0.009s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:42:51 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b078028-d93e-4e7f-8817-80e7670e6e41]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:42:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-38d1595d-08ca-4a3f-ac58-11de6ade11ce tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-716bb927-928e-4eec-b158-1cc6807233d0 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:51 devstack sudo[86520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-716bb927-928e-4eec-b158-1cc6807233d0
Feb 28 04:42:51 devstack sudo[86520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:51 devstack sudo[86516]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6ce414ce-ca46-4409-a2fb-e1139afcf1e1 tempest-SnapshotsActionsTest-1355677458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5" returned: 0 in 0.445s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:51 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-6ce414ce-ca46-4409-a2fb-e1139afcf1e1 tempest-SnapshotsActionsTest-1355677458 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:42:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-6ce414ce-ca46-4409-a2fb-e1139afcf1e1 tempest-SnapshotsActionsTest-1355677458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:42:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-cf0900a0-6a6d-493b-91bc-4d9b3f7d0ddc req-9b101931-340e-43c5-94c4-fd57350332e6 tempest-VolumesSnapshotsTestJSON-1400729173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.878s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:42:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6ce414ce-ca46-4409-a2fb-e1139afcf1e1 tempest-SnapshotsActionsTest-1355677458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (813fc3a2-1924-4e38-b8a7-00acc2cfe167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a27a465-7230-4e68-9540-285c134cf1c5', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:42:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6ce414ce-ca46-4409-a2fb-e1139afcf1e1 tempest-SnapshotsActionsTest-1355677458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d4ed6c9-b6a9-4245-a648-5fd35bbdfd7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:51 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [req-cf0900a0-6a6d-493b-91bc-4d9b3f7d0ddc req-9b101931-340e-43c5-94c4-fd57350332e6 tempest-VolumesSnapshotsTestJSON-1400729173 None] Creating offline snapshot 1573c7a5-ef4f-4b2c-9958-4d812ce47975 of volume 12bb03cd-b594-4546-83a7-dceae69971f4 {{(pid=84248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 04:42:51 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-6ce414ce-ca46-4409-a2fb-e1139afcf1e1 tempest-SnapshotsActionsTest-1355677458 None] Volume volume-0a27a465-7230-4e68-9540-285c134cf1c5 (0a27a465-7230-4e68-9540-285c134cf1c5): created successfully
Feb 28 04:42:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6ce414ce-ca46-4409-a2fb-e1139afcf1e1 tempest-SnapshotsActionsTest-1355677458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d4ed6c9-b6a9-4245-a648-5fd35bbdfd7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:42:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6ce414ce-ca46-4409-a2fb-e1139afcf1e1 tempest-SnapshotsActionsTest-1355677458 None] Flow 'volume_create_manager' (84390303-eb60-4079-9c3b-7d8ebc52fd85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:42:51 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b11016d-dd82-4856-9b5b-49324b25c7e0]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:42:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-cf0900a0-6a6d-493b-91bc-4d9b3f7d0ddc req-9b101931-340e-43c5-94c4-fd57350332e6 tempest-VolumesSnapshotsTestJSON-1400729173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:51 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-6ce414ce-ca46-4409-a2fb-e1139afcf1e1 tempest-SnapshotsActionsTest-1355677458 None] Created volume successfully.
Feb 28 04:42:51 devstack sudo[86523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4
Feb 28 04:42:51 devstack sudo[86523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:51 devstack sudo[86520]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-38d1595d-08ca-4a3f-ac58-11de6ade11ce tempest-GroupSnapshotsTest-1988525138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-716bb927-928e-4eec-b158-1cc6807233d0" returned: 0 in 0.544s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-38d1595d-08ca-4a3f-ac58-11de6ade11ce tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-716bb927-928e-4eec-b158-1cc6807233d0 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:51 devstack sudo[86528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-716bb927-928e-4eec-b158-1cc6807233d0
Feb 28 04:42:51 devstack sudo[86528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:52 devstack sudo[86523]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-cf0900a0-6a6d-493b-91bc-4d9b3f7d0ddc req-9b101931-340e-43c5-94c4-fd57350332e6 tempest-VolumesSnapshotsTestJSON-1400729173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4" returned: 0 in 0.545s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-cf0900a0-6a6d-493b-91bc-4d9b3f7d0ddc req-9b101931-340e-43c5-94c4-fd57350332e6 tempest-VolumesSnapshotsTestJSON-1400729173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4.1573c7a5-ef4f-4b2c-9958-4d812ce47975 1G {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:52 devstack sudo[86533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4.1573c7a5-ef4f-4b2c-9958-4d812ce47975 1G
Feb 28 04:42:52 devstack sudo[86533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-4905e958-4be1-4a83-a1da-6b0fb06135ed tempest-SnapshotsActionsTest-1355677458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:42:52 devstack sudo[86528]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-38d1595d-08ca-4a3f-ac58-11de6ade11ce tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-716bb927-928e-4eec-b158-1cc6807233d0" returned: 0 in 0.509s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:52 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-38d1595d-08ca-4a3f-ac58-11de6ade11ce tempest-GroupSnapshotsTest-1988525138 None] Lock "cinder-quobyte-716bb927-928e-4eec-b158-1cc6807233d0" released by "delete_volume" :: held 1.080s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:42:52 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-38d1595d-08ca-4a3f-ac58-11de6ade11ce tempest-GroupSnapshotsTest-1988525138 None] Created reservations ['1318879a-c4cf-4613-90a4-bf77e69d2f37'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:42:52 devstack cinder-volume[84248]: WARNING cinder.quota [None req-38d1595d-08ca-4a3f-ac58-11de6ade11ce tempest-GroupSnapshotsTest-1988525138 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-799134433 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-799134433, it is now deprecated. Please use the default quota class for default quota.
Feb 28 04:42:52 devstack cinder-volume[84248]: WARNING cinder.quota [None req-38d1595d-08ca-4a3f-ac58-11de6ade11ce tempest-GroupSnapshotsTest-1988525138 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-799134433 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-799134433, it is now deprecated. Please use the default quota class for default quota.
Feb 28 04:42:52 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-38d1595d-08ca-4a3f-ac58-11de6ade11ce tempest-GroupSnapshotsTest-1988525138 None] Created reservations ['7f7fb095-dc1c-401a-bdc4-65630d10280a', '4de38fbe-da18-4905-a3f8-daee79242783', 'e880cc2d-eefc-4415-aedd-5be255d867f1', '89a4da25-ec18-46ca-8619-fb44cc4c3d07'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:42:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-38d1595d-08ca-4a3f-ac58-11de6ade11ce tempest-GroupSnapshotsTest-1988525138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:42:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-38d1595d-08ca-4a3f-ac58-11de6ade11ce tempest-GroupSnapshotsTest-1988525138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:42:52 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-38d1595d-08ca-4a3f-ac58-11de6ade11ce tempest-GroupSnapshotsTest-1988525138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:42:52 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-38d1595d-08ca-4a3f-ac58-11de6ade11ce tempest-GroupSnapshotsTest-1988525138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:42:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-38d1595d-08ca-4a3f-ac58-11de6ade11ce tempest-GroupSnapshotsTest-1988525138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:42:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-38d1595d-08ca-4a3f-ac58-11de6ade11ce tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:52 devstack sudo[86536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:42:52 devstack sudo[86536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:52 devstack sudo[86533]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-cf0900a0-6a6d-493b-91bc-4d9b3f7d0ddc req-9b101931-340e-43c5-94c4-fd57350332e6 tempest-VolumesSnapshotsTestJSON-1400729173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4.1573c7a5-ef4f-4b2c-9958-4d812ce47975 1G" returned: 0 in 0.544s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-cf0900a0-6a6d-493b-91bc-4d9b3f7d0ddc req-9b101931-340e-43c5-94c4-fd57350332e6 tempest-VolumesSnapshotsTestJSON-1400729173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12bb03cd-b594-4546-83a7-dceae69971f4 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4.1573c7a5-ef4f-4b2c-9958-4d812ce47975 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:52 devstack sudo[86541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12bb03cd-b594-4546-83a7-dceae69971f4 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4.1573c7a5-ef4f-4b2c-9958-4d812ce47975
Feb 28 04:42:52 devstack sudo[86541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:52 devstack sudo[86536]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-38d1595d-08ca-4a3f-ac58-11de6ade11ce tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.451s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:52 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-38d1595d-08ca-4a3f-ac58-11de6ade11ce tempest-GroupSnapshotsTest-1988525138 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:42:52 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-38d1595d-08ca-4a3f-ac58-11de6ade11ce tempest-GroupSnapshotsTest-1988525138 None] Delete group completed successfully.
Feb 28 04:42:53 devstack sudo[86541]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-cf0900a0-6a6d-493b-91bc-4d9b3f7d0ddc req-9b101931-340e-43c5-94c4-fd57350332e6 tempest-VolumesSnapshotsTestJSON-1400729173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12bb03cd-b594-4546-83a7-dceae69971f4 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4.1573c7a5-ef4f-4b2c-9958-4d812ce47975" returned: 0 in 0.440s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:53 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [req-cf0900a0-6a6d-493b-91bc-4d9b3f7d0ddc req-9b101931-340e-43c5-94c4-fd57350332e6 tempest-VolumesSnapshotsTestJSON-1400729173 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4.1573c7a5-ef4f-4b2c-9958-4d812ce47975 is being set with open permissions: ugo+rw
Feb 28 04:42:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-cf0900a0-6a6d-493b-91bc-4d9b3f7d0ddc req-9b101931-340e-43c5-94c4-fd57350332e6 tempest-VolumesSnapshotsTestJSON-1400729173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4.1573c7a5-ef4f-4b2c-9958-4d812ce47975 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:53 devstack sudo[86547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4.1573c7a5-ef4f-4b2c-9958-4d812ce47975
Feb 28 04:42:53 devstack sudo[86547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:53 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-c26bf078-48be-407f-ac51-e773fdb7536d tempest-GroupSnapshotsTest-1988525138 None] group_snapshot c13cb783-9698-4074-91d1-e3517a99ca1c: deleting
Feb 28 04:42:53 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-c26bf078-48be-407f-ac51-e773fdb7536d tempest-GroupSnapshotsTest-1988525138 None] group_snapshot c13cb783-9698-4074-91d1-e3517a99ca1c: deleting {{(pid=84248) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Feb 28 04:42:53 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-c26bf078-48be-407f-ac51-e773fdb7536d tempest-GroupSnapshotsTest-1988525138 None] Acquiring lock "cinder-quobyte-3c20ec3c-29da-4769-a49c-300e09f32fdc" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:42:53 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-c26bf078-48be-407f-ac51-e773fdb7536d tempest-GroupSnapshotsTest-1988525138 None] Lock "cinder-quobyte-3c20ec3c-29da-4769-a49c-300e09f32fdc" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:42:53 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-c26bf078-48be-407f-ac51-e773fdb7536d tempest-GroupSnapshotsTest-1988525138 None] Acquiring lock "cinder-quobyte-af7d6f27-ece8-454c-b075-5180bd4e1760" by "_delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:42:53 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-c26bf078-48be-407f-ac51-e773fdb7536d tempest-GroupSnapshotsTest-1988525138 None] Lock "cinder-quobyte-af7d6f27-ece8-454c-b075-5180bd4e1760" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:42:53 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-c26bf078-48be-407f-ac51-e773fdb7536d tempest-GroupSnapshotsTest-1988525138 None] Deleting offline snapshot af7d6f27-ece8-454c-b075-5180bd4e1760 of volume 3c20ec3c-29da-4769-a49c-300e09f32fdc {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 04:42:53 devstack sudo[86547]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:53 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-c26bf078-48be-407f-ac51-e773fdb7536d tempest-GroupSnapshotsTest-1988525138 None] snapshot_file for this snap is: volume-3c20ec3c-29da-4769-a49c-300e09f32fdc.af7d6f27-ece8-454c-b075-5180bd4e1760 {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 04:42:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-cf0900a0-6a6d-493b-91bc-4d9b3f7d0ddc req-9b101931-340e-43c5-94c4-fd57350332e6 tempest-VolumesSnapshotsTestJSON-1400729173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4.1573c7a5-ef4f-4b2c-9958-4d812ce47975" returned: 0 in 0.484s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:53 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c43994f-87d5-49f3-b25d-71bfa52dae95]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:42:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-c26bf078-48be-407f-ac51-e773fdb7536d tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc.af7d6f27-ece8-454c-b075-5180bd4e1760 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-cf0900a0-6a6d-493b-91bc-4d9b3f7d0ddc req-9b101931-340e-43c5-94c4-fd57350332e6 tempest-VolumesSnapshotsTestJSON-1400729173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:53 devstack sudo[86552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4.info
Feb 28 04:42:53 devstack sudo[86552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:53 devstack sudo[86551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc.af7d6f27-ece8-454c-b075-5180bd4e1760
Feb 28 04:42:53 devstack sudo[86551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:54 devstack sudo[86552]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-cf0900a0-6a6d-493b-91bc-4d9b3f7d0ddc req-9b101931-340e-43c5-94c4-fd57350332e6 tempest-VolumesSnapshotsTestJSON-1400729173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4.info" returned: 0 in 0.471s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:54 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [req-cf0900a0-6a6d-493b-91bc-4d9b3f7d0ddc req-9b101931-340e-43c5-94c4-fd57350332e6 tempest-VolumesSnapshotsTestJSON-1400729173 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4.info is being set with open permissions: ugo+rw
Feb 28 04:42:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-cf0900a0-6a6d-493b-91bc-4d9b3f7d0ddc req-9b101931-340e-43c5-94c4-fd57350332e6 tempest-VolumesSnapshotsTestJSON-1400729173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:54 devstack sudo[86556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4.info
Feb 28 04:42:54 devstack sudo[86556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:54 devstack sudo[86551]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-c26bf078-48be-407f-ac51-e773fdb7536d tempest-GroupSnapshotsTest-1988525138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc.af7d6f27-ece8-454c-b075-5180bd4e1760" returned: 0 in 0.692s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:54 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-c26bf078-48be-407f-ac51-e773fdb7536d tempest-GroupSnapshotsTest-1988525138 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c20ec3c-29da-4769-a49c-300e09f32fdc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:42:54 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[708497dd-6af8-4600-a7a8-9311315f4c44]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:42:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-c26bf078-48be-407f-ac51-e773fdb7536d tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:54 devstack sudo[86561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc
Feb 28 04:42:54 devstack sudo[86561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:54 devstack sudo[86556]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-cf0900a0-6a6d-493b-91bc-4d9b3f7d0ddc req-9b101931-340e-43c5-94c4-fd57350332e6 tempest-VolumesSnapshotsTestJSON-1400729173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4.info" returned: 0 in 0.482s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-cf0900a0-6a6d-493b-91bc-4d9b3f7d0ddc req-9b101931-340e-43c5-94c4-fd57350332e6 tempest-VolumesSnapshotsTestJSON-1400729173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.088s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:42:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-4905e958-4be1-4a83-a1da-6b0fb06135ed tempest-SnapshotsActionsTest-1355677458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.365s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:42:54 devstack cinder-volume[84248]: INFO cinder.volume.manager [req-cf0900a0-6a6d-493b-91bc-4d9b3f7d0ddc req-9b101931-340e-43c5-94c4-fd57350332e6 tempest-VolumesSnapshotsTestJSON-1400729173 None] Create snapshot completed successfully
Feb 28 04:42:54 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-4905e958-4be1-4a83-a1da-6b0fb06135ed tempest-SnapshotsActionsTest-1355677458 None] Creating offline snapshot 66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc of volume 0a27a465-7230-4e68-9540-285c134cf1c5 {{(pid=84248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 04:42:54 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c4325e-3bb4-409f-9a08-20eef6efff3f]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:42:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4905e958-4be1-4a83-a1da-6b0fb06135ed tempest-SnapshotsActionsTest-1355677458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:54 devstack sudo[86564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5
Feb 28 04:42:54 devstack sudo[86564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:54 devstack sudo[86561]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-c26bf078-48be-407f-ac51-e773fdb7536d tempest-GroupSnapshotsTest-1988525138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc" returned: 0 in 0.576s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-c26bf078-48be-407f-ac51-e773fdb7536d tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc.af7d6f27-ece8-454c-b075-5180bd4e1760 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:54 devstack sudo[86569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc.af7d6f27-ece8-454c-b075-5180bd4e1760
Feb 28 04:42:54 devstack sudo[86569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:55 devstack cinder-volume[84248]: DEBUG cinder.coordination [req-f611f418-5e1d-4c86-9b5a-4824ab7f568f req-7e8a83bd-9e63-4216-a991-6b778567fa63 tempest-VolumesSnapshotsTestJSON-1400729173 None] Acquiring lock "cinder-1573c7a5-ef4f-4b2c-9958-4d812ce47975-delete_snapshot" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:42:55 devstack cinder-volume[84248]: DEBUG cinder.coordination [req-f611f418-5e1d-4c86-9b5a-4824ab7f568f req-7e8a83bd-9e63-4216-a991-6b778567fa63 tempest-VolumesSnapshotsTestJSON-1400729173 None] Lock "cinder-1573c7a5-ef4f-4b2c-9958-4d812ce47975-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:42:55 devstack cinder-volume[84248]: DEBUG cinder.coordination [req-f611f418-5e1d-4c86-9b5a-4824ab7f568f req-7e8a83bd-9e63-4216-a991-6b778567fa63 tempest-VolumesSnapshotsTestJSON-1400729173 None] Acquiring lock "cinder-quobyte-12bb03cd-b594-4546-83a7-dceae69971f4" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:42:55 devstack sudo[86564]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4905e958-4be1-4a83-a1da-6b0fb06135ed tempest-SnapshotsActionsTest-1355677458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5" returned: 0 in 0.515s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:55 devstack cinder-volume[84248]: DEBUG cinder.coordination [req-f611f418-5e1d-4c86-9b5a-4824ab7f568f req-7e8a83bd-9e63-4216-a991-6b778567fa63 tempest-VolumesSnapshotsTestJSON-1400729173 None] Lock "cinder-quobyte-12bb03cd-b594-4546-83a7-dceae69971f4" acquired by "delete_snapshot" :: waited 0.022s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:42:55 devstack cinder-volume[84248]: DEBUG cinder.coordination [req-f611f418-5e1d-4c86-9b5a-4824ab7f568f req-7e8a83bd-9e63-4216-a991-6b778567fa63 tempest-VolumesSnapshotsTestJSON-1400729173 None] Acquiring lock "cinder-quobyte-1573c7a5-ef4f-4b2c-9958-4d812ce47975" by "_delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:42:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4905e958-4be1-4a83-a1da-6b0fb06135ed tempest-SnapshotsActionsTest-1355677458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc 1G {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:55 devstack cinder-volume[84248]: DEBUG cinder.coordination [req-f611f418-5e1d-4c86-9b5a-4824ab7f568f req-7e8a83bd-9e63-4216-a991-6b778567fa63 tempest-VolumesSnapshotsTestJSON-1400729173 None] Lock "cinder-quobyte-1573c7a5-ef4f-4b2c-9958-4d812ce47975" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:42:55 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [req-f611f418-5e1d-4c86-9b5a-4824ab7f568f req-7e8a83bd-9e63-4216-a991-6b778567fa63 tempest-VolumesSnapshotsTestJSON-1400729173 None] Deleting offline snapshot 1573c7a5-ef4f-4b2c-9958-4d812ce47975 of volume 12bb03cd-b594-4546-83a7-dceae69971f4 {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 04:42:55 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [req-f611f418-5e1d-4c86-9b5a-4824ab7f568f req-7e8a83bd-9e63-4216-a991-6b778567fa63 tempest-VolumesSnapshotsTestJSON-1400729173 None] snapshot_file for this snap is: volume-12bb03cd-b594-4546-83a7-dceae69971f4.1573c7a5-ef4f-4b2c-9958-4d812ce47975 {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 04:42:55 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[37723ca9-47b7-42c5-b635-e0dcd9b08ba4]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:42:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-f611f418-5e1d-4c86-9b5a-4824ab7f568f req-7e8a83bd-9e63-4216-a991-6b778567fa63 tempest-VolumesSnapshotsTestJSON-1400729173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4.1573c7a5-ef4f-4b2c-9958-4d812ce47975 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:55 devstack sudo[86574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc 1G
Feb 28 04:42:55 devstack sudo[86574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:55 devstack sudo[86575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4.1573c7a5-ef4f-4b2c-9958-4d812ce47975
Feb 28 04:42:55 devstack sudo[86575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:55 devstack sudo[86569]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-c26bf078-48be-407f-ac51-e773fdb7536d tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc.af7d6f27-ece8-454c-b075-5180bd4e1760" returned: 0 in 0.975s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-c26bf078-48be-407f-ac51-e773fdb7536d tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc.af7d6f27-ece8-454c-b075-5180bd4e1760 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:55 devstack sudo[86583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc.af7d6f27-ece8-454c-b075-5180bd4e1760
Feb 28 04:42:55 devstack sudo[86583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:56 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:42:56 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Flow 'volume_create_manager' (29d5aacb-220e-4f3b-b2a9-c7125e2beaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:42:56 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d09398ff-6a84-4e9e-9335-819a26be25a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:56 devstack sudo[86575]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:56 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d09398ff-6a84-4e9e-9335-819a26be25a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:42:56Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8e0796a-39b2-4dc1-b3c9-d019f0196d52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca2eb5fbb88b4897bd842d0e6d327320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:42:56Z,use_quota=True,user_id='62168aa8c3fd406f8acc081b76e769a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:42:56 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3b2a26c-36bb-4754-9507-e244bd36c644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:56 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3b2a26c-36bb-4754-9507-e244bd36c644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:42:56 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57410c20-1e64-4397-a886-015f4f9c43e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:56 devstack cinder-volume[84248]: DEBUG cinder.image.glance [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Creating Keystone auth plugin from conf {{(pid=84248) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Feb 28 04:42:56 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-f611f418-5e1d-4c86-9b5a-4824ab7f568f req-7e8a83bd-9e63-4216-a991-6b778567fa63 tempest-VolumesSnapshotsTestJSON-1400729173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4.1573c7a5-ef4f-4b2c-9958-4d812ce47975" returned: 0 in 0.925s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:56 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [req-f611f418-5e1d-4c86-9b5a-4824ab7f568f req-7e8a83bd-9e63-4216-a991-6b778567fa63 tempest-VolumesSnapshotsTestJSON-1400729173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12bb03cd-b594-4546-83a7-dceae69971f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:42:56 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae30b3ba-4f4e-461a-9e61-6f39f7d0de6c]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:42:56 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-f611f418-5e1d-4c86-9b5a-4824ab7f568f req-7e8a83bd-9e63-4216-a991-6b778567fa63 tempest-VolumesSnapshotsTestJSON-1400729173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:56 devstack sudo[86574]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:56 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4905e958-4be1-4a83-a1da-6b0fb06135ed tempest-SnapshotsActionsTest-1355677458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc 1G" returned: 0 in 1.094s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:56 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4905e958-4be1-4a83-a1da-6b0fb06135ed tempest-SnapshotsActionsTest-1355677458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a27a465-7230-4e68-9540-285c134cf1c5 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:56 devstack sudo[86591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4
Feb 28 04:42:56 devstack sudo[86591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:56 devstack sudo[86592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a27a465-7230-4e68-9540-285c134cf1c5 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc
Feb 28 04:42:56 devstack sudo[86592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:56 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57410c20-1e64-4397-a886-015f4f9c43e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f8e0796a-39b2-4dc1-b3c9-d019f0196d52', 'volume_name': 'volume-f8e0796a-39b2-4dc1-b3c9-d019f0196d52', 'volume_size': 1, 'image_id': '2c3eb214-ef72-4569-9890-199b020755f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2c3eb214-ef72-4569-9890-199b020755f9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c0fde1a75874ab3961d0c965899b1f4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2c3eb214-ef72-4569-9890-199b020755f9', 'created_at': datetime.datetime(2026, 2, 28, 3, 36, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 28, 3, 36, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2c3eb214-ef72-4569-9890-199b020755f9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5e40162f50>}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:42:56 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d9d07d-f091-4f17-84d0-00bf74a4aeb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:56 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d9d07d-f091-4f17-84d0-00bf74a4aeb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:42:56 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85b27dd8-a34c-4d31-bfcd-6be6be8e2b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:42:56 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Volume f8e0796a-39b2-4dc1-b3c9-d019f0196d52: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f8e0796a-39b2-4dc1-b3c9-d019f0196d52', 'volume_size': 1, 'image_id': '2c3eb214-ef72-4569-9890-199b020755f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2c3eb214-ef72-4569-9890-199b020755f9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c0fde1a75874ab3961d0c965899b1f4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2c3eb214-ef72-4569-9890-199b020755f9', 'created_at': datetime.datetime(2026, 2, 28, 3, 36, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 28, 3, 36, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2c3eb214-ef72-4569-9890-199b020755f9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5e40162f50>}
Feb 28 04:42:56 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Trying to clone f8e0796a-39b2-4dc1-b3c9-d019f0196d52 from image 2c3eb214-ef72-4569-9890-199b020755f9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2c3eb214-ef72-4569-9890-199b020755f9', 'metadata': {}}]). {{(pid=84248) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Feb 28 04:42:56 devstack sudo[86583]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:56 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-c26bf078-48be-407f-ac51-e773fdb7536d tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc.af7d6f27-ece8-454c-b075-5180bd4e1760" returned: 0 in 0.737s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:56 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-c26bf078-48be-407f-ac51-e773fdb7536d tempest-GroupSnapshotsTest-1988525138 None] Lock "cinder-quobyte-af7d6f27-ece8-454c-b075-5180bd4e1760" released by "_delete_snapshot" :: held 3.067s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:42:56 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-c26bf078-48be-407f-ac51-e773fdb7536d tempest-GroupSnapshotsTest-1988525138 None] Lock "cinder-quobyte-3c20ec3c-29da-4769-a49c-300e09f32fdc" released by "delete_snapshot" :: held 3.082s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:42:56 devstack cinder-volume[84248]: WARNING cinder.quota [None req-c26bf078-48be-407f-ac51-e773fdb7536d tempest-GroupSnapshotsTest-1988525138 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-799134433 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-799134433, it is now deprecated. Please use the default quota class for default quota.
Feb 28 04:42:56 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-c26bf078-48be-407f-ac51-e773fdb7536d tempest-GroupSnapshotsTest-1988525138 None] Created reservations ['7d3fe6b7-17cc-42b3-8fb9-0f4010629736', 'd31f15ea-1c9b-4f2f-a370-a13e2c1fbd16', '0222038d-ea76-4222-a409-3a45a740034c', '53c99466-417f-4177-9b4b-b8e1c3d995e4'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:42:56 devstack sudo[86591]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:56 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-f611f418-5e1d-4c86-9b5a-4824ab7f568f req-7e8a83bd-9e63-4216-a991-6b778567fa63 tempest-VolumesSnapshotsTestJSON-1400729173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4" returned: 0 in 0.817s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:56 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-f611f418-5e1d-4c86-9b5a-4824ab7f568f req-7e8a83bd-9e63-4216-a991-6b778567fa63 tempest-VolumesSnapshotsTestJSON-1400729173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4.1573c7a5-ef4f-4b2c-9958-4d812ce47975 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:56 devstack sudo[86623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4.1573c7a5-ef4f-4b2c-9958-4d812ce47975
Feb 28 04:42:56 devstack sudo[86623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:56 devstack cinder-volume[84248]: DEBUG cinder.image.image_utils [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_69qfse7kdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84248) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Feb 28 04:42:56 devstack cinder-volume[84248]: INFO cinder.image.image_utils [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Image download 20.69 MB at 20.69 MB/s
Feb 28 04:42:57 devstack sudo[86592]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:57 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d58891-9e75-44fd-a7e4-3fbcdf016375]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:42:57 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_69qfse7kdevstack@QuobyteHD {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:57 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-c26bf078-48be-407f-ac51-e773fdb7536d tempest-GroupSnapshotsTest-1988525138 None] group_snapshot c13cb783-9698-4074-91d1-e3517a99ca1c: deleted successfully
Feb 28 04:42:57 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4905e958-4be1-4a83-a1da-6b0fb06135ed tempest-SnapshotsActionsTest-1355677458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a27a465-7230-4e68-9540-285c134cf1c5 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc" returned: 0 in 0.874s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:57 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-4905e958-4be1-4a83-a1da-6b0fb06135ed tempest-SnapshotsActionsTest-1355677458 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc is being set with open permissions: ugo+rw
Feb 28 04:42:57 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4905e958-4be1-4a83-a1da-6b0fb06135ed tempest-SnapshotsActionsTest-1355677458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:57 devstack sudo[86626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc
Feb 28 04:42:57 devstack sudo[86626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:57 devstack sudo[86625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_69qfse7kdevstack@QuobyteHD
Feb 28 04:42:57 devstack sudo[86625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:57 devstack sudo[86623]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:57 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-f611f418-5e1d-4c86-9b5a-4824ab7f568f req-7e8a83bd-9e63-4216-a991-6b778567fa63 tempest-VolumesSnapshotsTestJSON-1400729173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4.1573c7a5-ef4f-4b2c-9958-4d812ce47975" returned: 0 in 0.532s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:57 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-f611f418-5e1d-4c86-9b5a-4824ab7f568f req-7e8a83bd-9e63-4216-a991-6b778567fa63 tempest-VolumesSnapshotsTestJSON-1400729173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4.1573c7a5-ef4f-4b2c-9958-4d812ce47975 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:57 devstack sudo[86633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4.1573c7a5-ef4f-4b2c-9958-4d812ce47975
Feb 28 04:42:57 devstack sudo[86633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:57 devstack sudo[86626]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:57 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4905e958-4be1-4a83-a1da-6b0fb06135ed tempest-SnapshotsActionsTest-1355677458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc" returned: 0 in 0.470s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:57 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4905e958-4be1-4a83-a1da-6b0fb06135ed tempest-SnapshotsActionsTest-1355677458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:57 devstack sudo[86638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.info
Feb 28 04:42:57 devstack sudo[86638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:57 devstack sudo[86625]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:57 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_69qfse7kdevstack@QuobyteHD" returned: 0 in 0.561s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:57 devstack cinder-volume[84248]: DEBUG cinder.image.image_utils [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Temporary image 2c3eb214-ef72-4569-9890-199b020755f9 is fetched for user 62168aa8c3fd406f8acc081b76e769a6. {{(pid=84248) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Feb 28 04:42:57 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd83838c-3d81-4034-983e-9d608f32edd0]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:42:57 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_69qfse7kdevstack@QuobyteHD {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:57 devstack sudo[86640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_69qfse7kdevstack@QuobyteHD
Feb 28 04:42:57 devstack sudo[86640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:58 devstack sudo[86633]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:58 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-f611f418-5e1d-4c86-9b5a-4824ab7f568f req-7e8a83bd-9e63-4216-a991-6b778567fa63 tempest-VolumesSnapshotsTestJSON-1400729173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4.1573c7a5-ef4f-4b2c-9958-4d812ce47975" returned: 0 in 0.606s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:58 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-731d9289-6877-48ca-9803-d585adcce7d9 tempest-GroupSnapshotsTest-1988525138 None] Acquiring lock "cinder-quobyte-3c20ec3c-29da-4769-a49c-300e09f32fdc" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:42:58 devstack cinder-volume[84248]: DEBUG cinder.coordination [req-f611f418-5e1d-4c86-9b5a-4824ab7f568f req-7e8a83bd-9e63-4216-a991-6b778567fa63 tempest-VolumesSnapshotsTestJSON-1400729173 None] Lock "cinder-quobyte-1573c7a5-ef4f-4b2c-9958-4d812ce47975" released by "_delete_snapshot" :: held 2.995s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:42:58 devstack cinder-volume[84248]: DEBUG cinder.coordination [req-f611f418-5e1d-4c86-9b5a-4824ab7f568f req-7e8a83bd-9e63-4216-a991-6b778567fa63 tempest-VolumesSnapshotsTestJSON-1400729173 None] Lock "cinder-quobyte-12bb03cd-b594-4546-83a7-dceae69971f4" released by "delete_snapshot" :: held 3.048s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:42:58 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-731d9289-6877-48ca-9803-d585adcce7d9 tempest-GroupSnapshotsTest-1988525138 None] Lock "cinder-quobyte-3c20ec3c-29da-4769-a49c-300e09f32fdc" acquired by "delete_volume" :: waited 0.026s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:42:58 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d58e35-7565-4df3-8d77-bf6f633124e2]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:42:58 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-731d9289-6877-48ca-9803-d585adcce7d9 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:58 devstack cinder-volume[84248]: WARNING cinder.quota [req-f611f418-5e1d-4c86-9b5a-4824ab7f568f req-7e8a83bd-9e63-4216-a991-6b778567fa63 tempest-VolumesSnapshotsTestJSON-1400729173 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Feb 28 04:42:58 devstack cinder-volume[84248]: DEBUG cinder.quota [req-f611f418-5e1d-4c86-9b5a-4824ab7f568f req-7e8a83bd-9e63-4216-a991-6b778567fa63 tempest-VolumesSnapshotsTestJSON-1400729173 None] Created reservations ['d06cf79a-f893-4a9f-8e90-6d67bbfc964f', '88ddfad5-e28a-4b4b-97dd-397017fc81a0', '76372c7b-0196-49ba-826f-656745fa676b', '8c30bbd8-7769-4306-9365-0ac3933eda3b'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:42:58 devstack cinder-volume[84248]: INFO cinder.volume.manager [req-f611f418-5e1d-4c86-9b5a-4824ab7f568f req-7e8a83bd-9e63-4216-a991-6b778567fa63 tempest-VolumesSnapshotsTestJSON-1400729173 None] Delete snapshot completed successfully.
Feb 28 04:42:58 devstack cinder-volume[84248]: DEBUG cinder.coordination [req-f611f418-5e1d-4c86-9b5a-4824ab7f568f req-7e8a83bd-9e63-4216-a991-6b778567fa63 tempest-VolumesSnapshotsTestJSON-1400729173 None] Lock "cinder-1573c7a5-ef4f-4b2c-9958-4d812ce47975-delete_snapshot" released by "delete_snapshot" :: held 3.312s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:42:58 devstack sudo[86640]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:58 devstack sudo[86643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc
Feb 28 04:42:58 devstack sudo[86643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:58 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_69qfse7kdevstack@QuobyteHD" returned: 0 in 0.764s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:58 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:42:58 devstack cinder-volume[84248]: DEBUG cinder.coordination [req-0f2d35dc-5e8b-436d-a04e-71ebf6ebe328 req-1631b6c0-24f5-43ef-a4b7-7ed2441afb09 tempest-VolumesSnapshotsTestJSON-1400729173 None] Acquiring lock "cinder-12bb03cd-b594-4546-83a7-dceae69971f4-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:42:58 devstack cinder-volume[84248]: DEBUG cinder.coordination [req-0f2d35dc-5e8b-436d-a04e-71ebf6ebe328 req-1631b6c0-24f5-43ef-a4b7-7ed2441afb09 tempest-VolumesSnapshotsTestJSON-1400729173 None] Lock "cinder-12bb03cd-b594-4546-83a7-dceae69971f4-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:42:58 devstack sudo[86638]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:58 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4905e958-4be1-4a83-a1da-6b0fb06135ed tempest-SnapshotsActionsTest-1355677458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.info" returned: 0 in 0.929s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:58 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-4905e958-4be1-4a83-a1da-6b0fb06135ed tempest-SnapshotsActionsTest-1355677458 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.info is being set with open permissions: ugo+rw
Feb 28 04:42:58 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4905e958-4be1-4a83-a1da-6b0fb06135ed tempest-SnapshotsActionsTest-1355677458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:58 devstack sudo[86649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.info
Feb 28 04:42:58 devstack sudo[86649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:58 devstack cinder-volume[84248]: DEBUG cinder.coordination [req-0f2d35dc-5e8b-436d-a04e-71ebf6ebe328 req-1631b6c0-24f5-43ef-a4b7-7ed2441afb09 tempest-VolumesSnapshotsTestJSON-1400729173 None] Acquiring lock "cinder-quobyte-12bb03cd-b594-4546-83a7-dceae69971f4" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:42:58 devstack cinder-volume[84248]: DEBUG cinder.coordination [req-0f2d35dc-5e8b-436d-a04e-71ebf6ebe328 req-1631b6c0-24f5-43ef-a4b7-7ed2441afb09 tempest-VolumesSnapshotsTestJSON-1400729173 None] Lock "cinder-quobyte-12bb03cd-b594-4546-83a7-dceae69971f4" acquired by "delete_volume" :: waited 0.009s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:42:58 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c3d4bb-6384-4b22-b96b-8e875dc68104]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:42:58 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-0f2d35dc-5e8b-436d-a04e-71ebf6ebe328 req-1631b6c0-24f5-43ef-a4b7-7ed2441afb09 tempest-VolumesSnapshotsTestJSON-1400729173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:58 devstack sudo[86652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4
Feb 28 04:42:58 devstack sudo[86652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:58 devstack sudo[86649]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:58 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4905e958-4be1-4a83-a1da-6b0fb06135ed tempest-SnapshotsActionsTest-1355677458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.info" returned: 0 in 0.487s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:58 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-4905e958-4be1-4a83-a1da-6b0fb06135ed tempest-SnapshotsActionsTest-1355677458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.442s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:42:58 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.563s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:42:58 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:42:56Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8e0796a-39b2-4dc1-b3c9-d019f0196d52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca2eb5fbb88b4897bd842d0e6d327320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:42:56Z,use_quota=True,user_id='62168aa8c3fd406f8acc081b76e769a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:42:58 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Creating volume f8e0796a-39b2-4dc1-b3c9-d019f0196d52 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:42:58 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:42:58 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:42:58 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:42:58 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:42:58 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:42:58 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:42:59 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:42:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f8e0796a-39b2-4dc1-b3c9-d019f0196d52 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:59 devstack sudo[86667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f8e0796a-39b2-4dc1-b3c9-d019f0196d52 1073741824
Feb 28 04:42:59 devstack sudo[86667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:59 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-4905e958-4be1-4a83-a1da-6b0fb06135ed tempest-SnapshotsActionsTest-1355677458 None] Create snapshot completed successfully
Feb 28 04:42:59 devstack sudo[86643]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-731d9289-6877-48ca-9803-d585adcce7d9 tempest-GroupSnapshotsTest-1988525138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc" returned: 0 in 0.864s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-731d9289-6877-48ca-9803-d585adcce7d9 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:59 devstack sudo[86672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc
Feb 28 04:42:59 devstack sudo[86672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:59 devstack sudo[86652]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-0f2d35dc-5e8b-436d-a04e-71ebf6ebe328 req-1631b6c0-24f5-43ef-a4b7-7ed2441afb09 tempest-VolumesSnapshotsTestJSON-1400729173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4" returned: 0 in 0.591s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-0f2d35dc-5e8b-436d-a04e-71ebf6ebe328 req-1631b6c0-24f5-43ef-a4b7-7ed2441afb09 tempest-VolumesSnapshotsTestJSON-1400729173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:59 devstack sudo[86674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4
Feb 28 04:42:59 devstack sudo[86674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:59 devstack sudo[86672]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-731d9289-6877-48ca-9803-d585adcce7d9 tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3c20ec3c-29da-4769-a49c-300e09f32fdc" returned: 0 in 0.631s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:59 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-731d9289-6877-48ca-9803-d585adcce7d9 tempest-GroupSnapshotsTest-1988525138 None] Lock "cinder-quobyte-3c20ec3c-29da-4769-a49c-300e09f32fdc" released by "delete_volume" :: held 1.562s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:42:59 devstack sudo[86674]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-0f2d35dc-5e8b-436d-a04e-71ebf6ebe328 req-1631b6c0-24f5-43ef-a4b7-7ed2441afb09 tempest-VolumesSnapshotsTestJSON-1400729173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-12bb03cd-b594-4546-83a7-dceae69971f4" returned: 0 in 0.594s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:59 devstack cinder-volume[84248]: DEBUG cinder.coordination [req-0f2d35dc-5e8b-436d-a04e-71ebf6ebe328 req-1631b6c0-24f5-43ef-a4b7-7ed2441afb09 tempest-VolumesSnapshotsTestJSON-1400729173 None] Lock "cinder-quobyte-12bb03cd-b594-4546-83a7-dceae69971f4" released by "delete_volume" :: held 1.241s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:42:59 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-731d9289-6877-48ca-9803-d585adcce7d9 tempest-GroupSnapshotsTest-1988525138 None] Created reservations ['9869d0df-87ac-4926-a373-f16e0cd68e4e'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:42:59 devstack cinder-volume[84248]: DEBUG cinder.quota [req-0f2d35dc-5e8b-436d-a04e-71ebf6ebe328 req-1631b6c0-24f5-43ef-a4b7-7ed2441afb09 tempest-VolumesSnapshotsTestJSON-1400729173 None] Created reservations ['d1dfc2f6-22e5-413a-b962-d643197ca683', '5f3eb06d-92da-45fa-8310-67fd959b89d9', 'ec5c7eb0-98be-4310-aa65-bb6d6ab83e0e', 'af1b7079-3acc-421a-bfbb-3d811d1c0ee4'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:42:59 devstack cinder-volume[84248]: WARNING cinder.db.sqlalchemy.api [None req-731d9289-6877-48ca-9803-d585adcce7d9 tempest-GroupSnapshotsTest-1988525138 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-799134433']
Feb 28 04:42:59 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-731d9289-6877-48ca-9803-d585adcce7d9 tempest-GroupSnapshotsTest-1988525138 None] Created reservations ['8616392a-b82a-4b25-8746-b974229e8361', 'c0f49e23-e7bd-4749-b084-bdf8554323e8', 'c2872ba1-897d-4843-9f1e-ec3201dd1d14', 'aad3c835-1aa2-4ea7-9324-ddb8fcb5355b'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:42:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-0f2d35dc-5e8b-436d-a04e-71ebf6ebe328 req-1631b6c0-24f5-43ef-a4b7-7ed2441afb09 tempest-VolumesSnapshotsTestJSON-1400729173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:42:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-0f2d35dc-5e8b-436d-a04e-71ebf6ebe328 req-1631b6c0-24f5-43ef-a4b7-7ed2441afb09 tempest-VolumesSnapshotsTestJSON-1400729173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:42:59 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [req-0f2d35dc-5e8b-436d-a04e-71ebf6ebe328 req-1631b6c0-24f5-43ef-a4b7-7ed2441afb09 tempest-VolumesSnapshotsTestJSON-1400729173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:42:59 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [req-0f2d35dc-5e8b-436d-a04e-71ebf6ebe328 req-1631b6c0-24f5-43ef-a4b7-7ed2441afb09 tempest-VolumesSnapshotsTestJSON-1400729173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:42:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-0f2d35dc-5e8b-436d-a04e-71ebf6ebe328 req-1631b6c0-24f5-43ef-a4b7-7ed2441afb09 tempest-VolumesSnapshotsTestJSON-1400729173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:42:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-0f2d35dc-5e8b-436d-a04e-71ebf6ebe328 req-1631b6c0-24f5-43ef-a4b7-7ed2441afb09 tempest-VolumesSnapshotsTestJSON-1400729173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:59 devstack sudo[86714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:42:59 devstack sudo[86714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:42:59 devstack sudo[86667]: pam_unix(sudo:session): session closed for user root
Feb 28 04:42:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f8e0796a-39b2-4dc1-b3c9-d019f0196d52 1073741824" returned: 0 in 0.911s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:42:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f8e0796a-39b2-4dc1-b3c9-d019f0196d52 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-731d9289-6877-48ca-9803-d585adcce7d9 tempest-GroupSnapshotsTest-1988525138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:42:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-731d9289-6877-48ca-9803-d585adcce7d9 tempest-GroupSnapshotsTest-1988525138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:42:59 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-731d9289-6877-48ca-9803-d585adcce7d9 tempest-GroupSnapshotsTest-1988525138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:42:59 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-731d9289-6877-48ca-9803-d585adcce7d9 tempest-GroupSnapshotsTest-1988525138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:42:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-731d9289-6877-48ca-9803-d585adcce7d9 tempest-GroupSnapshotsTest-1988525138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:42:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-731d9289-6877-48ca-9803-d585adcce7d9 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:42:59 devstack sudo[86717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f8e0796a-39b2-4dc1-b3c9-d019f0196d52
Feb 28 04:42:59 devstack sudo[86717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-dc88d8b2-b170-4d3f-bfab-a97054291efe tempest-SnapshotsActionsTest-1355677458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:43:00 devstack sudo[86719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:43:00 devstack sudo[86719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:00 devstack sudo[86714]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-0f2d35dc-5e8b-436d-a04e-71ebf6ebe328 req-1631b6c0-24f5-43ef-a4b7-7ed2441afb09 tempest-VolumesSnapshotsTestJSON-1400729173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.420s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:00 devstack cinder-volume[84248]: DEBUG cinder.manager [req-0f2d35dc-5e8b-436d-a04e-71ebf6ebe328 req-1631b6c0-24f5-43ef-a4b7-7ed2441afb09 tempest-VolumesSnapshotsTestJSON-1400729173 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:43:00 devstack cinder-volume[84248]: INFO cinder.volume.manager [req-0f2d35dc-5e8b-436d-a04e-71ebf6ebe328 req-1631b6c0-24f5-43ef-a4b7-7ed2441afb09 tempest-VolumesSnapshotsTestJSON-1400729173 None] Deleted volume successfully.
Feb 28 04:43:00 devstack cinder-volume[84248]: DEBUG cinder.coordination [req-0f2d35dc-5e8b-436d-a04e-71ebf6ebe328 req-1631b6c0-24f5-43ef-a4b7-7ed2441afb09 tempest-VolumesSnapshotsTestJSON-1400729173 None] Lock "cinder-12bb03cd-b594-4546-83a7-dceae69971f4-delete_volume" released by "delete_volume" :: held 1.863s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:43:00 devstack sudo[86719]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-731d9289-6877-48ca-9803-d585adcce7d9 tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.466s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:00 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-731d9289-6877-48ca-9803-d585adcce7d9 tempest-GroupSnapshotsTest-1988525138 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:43:00 devstack sudo[86717]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:00 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-731d9289-6877-48ca-9803-d585adcce7d9 tempest-GroupSnapshotsTest-1988525138 None] Delete group completed successfully.
Feb 28 04:43:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f8e0796a-39b2-4dc1-b3c9-d019f0196d52" returned: 0 in 0.505s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:00 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:43:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:43:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-dc88d8b2-b170-4d3f-bfab-a97054291efe tempest-SnapshotsActionsTest-1355677458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.480s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:43:00 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-dc88d8b2-b170-4d3f-bfab-a97054291efe tempest-SnapshotsActionsTest-1355677458 None] Creating offline snapshot 63c6c7f9-db50-4fe6-a592-fbf09558a0be of volume 0a27a465-7230-4e68-9540-285c134cf1c5 {{(pid=84248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 04:43:00 devstack cinder-volume[84248]: DEBUG cinder.volume.volume_utils [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Attempting download of 2c3eb214-ef72-4569-9890-199b020755f9 ((None, [{'url': 'file:///opt/stack/data/glance/images/2c3eb214-ef72-4569-9890-199b020755f9', 'metadata': {}}])) to volume f8e0796a-39b2-4dc1-b3c9-d019f0196d52. {{(pid=84248) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Feb 28 04:43:00 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99f397c-ba47-4592-8d86-af29ca751efd]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:43:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dc88d8b2-b170-4d3f-bfab-a97054291efe tempest-SnapshotsActionsTest-1355677458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:00 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[47193627-d2c5-46a5-a846-0078239d093b]: (4, 'raw') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:43:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2c3eb214-ef72-4569-9890-199b020755f9_st6a0o3z {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:00 devstack sudo[86724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc
Feb 28 04:43:00 devstack sudo[86724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:00 devstack sudo[86725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2c3eb214-ef72-4569-9890-199b020755f9_st6a0o3z
Feb 28 04:43:00 devstack sudo[86725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:00 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-514b1f32-022c-4ee8-ade3-8fff657fe498 tempest-GroupSnapshotsTest-1988525138 None] Group tempest-GroupSnapshotsTest-Group-231887367: creating
Feb 28 04:43:00 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-514b1f32-022c-4ee8-ade3-8fff657fe498 tempest-GroupSnapshotsTest-1988525138 None] Group tempest-GroupSnapshotsTest-Group-231887367: created successfully
Feb 28 04:43:00 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-514b1f32-022c-4ee8-ade3-8fff657fe498 tempest-GroupSnapshotsTest-1988525138 None] Create group completed successfully.
Feb 28 04:43:01 devstack sudo[86724]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dc88d8b2-b170-4d3f-bfab-a97054291efe tempest-SnapshotsActionsTest-1355677458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc" returned: 0 in 0.607s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:01 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-dc88d8b2-b170-4d3f-bfab-a97054291efe tempest-SnapshotsActionsTest-1355677458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a27a465-7230-4e68-9540-285c134cf1c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:43:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dc88d8b2-b170-4d3f-bfab-a97054291efe tempest-SnapshotsActionsTest-1355677458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.63c6c7f9-db50-4fe6-a592-fbf09558a0be 1G {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:01 devstack sudo[86732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.63c6c7f9-db50-4fe6-a592-fbf09558a0be 1G
Feb 28 04:43:01 devstack sudo[86732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:01 devstack sudo[86725]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2c3eb214-ef72-4569-9890-199b020755f9_st6a0o3z" returned: 0 in 0.631s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c3eb214-ef72-4569-9890-199b020755f9_st6a0o3z {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:01 devstack sudo[86735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c3eb214-ef72-4569-9890-199b020755f9_st6a0o3z
Feb 28 04:43:01 devstack sudo[86735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:01 devstack sudo[86732]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dc88d8b2-b170-4d3f-bfab-a97054291efe tempest-SnapshotsActionsTest-1355677458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.63c6c7f9-db50-4fe6-a592-fbf09558a0be 1G" returned: 0 in 0.702s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dc88d8b2-b170-4d3f-bfab-a97054291efe tempest-SnapshotsActionsTest-1355677458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.63c6c7f9-db50-4fe6-a592-fbf09558a0be {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:01 devstack sudo[86742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.63c6c7f9-db50-4fe6-a592-fbf09558a0be
Feb 28 04:43:01 devstack sudo[86742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:01 devstack sudo[86735]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c3eb214-ef72-4569-9890-199b020755f9_st6a0o3z" returned: 1 in 0.699s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c3eb214-ef72-4569-9890-199b020755f9_st6a0o3z' failed. Not Retrying. {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 28 04:43:01 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3b35ab-3b42-41d1-bc3f-63b901724713]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:43:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_69qfse7kdevstack@QuobyteHD {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:02 devstack sudo[86744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_69qfse7kdevstack@QuobyteHD
Feb 28 04:43:02 devstack sudo[86744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:02 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-445d28e0-a146-4592-9b05-e564c26aab49 tempest-GroupSnapshotsTest-1988525138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:43:02 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-445d28e0-a146-4592-9b05-e564c26aab49 tempest-GroupSnapshotsTest-1988525138 None] Flow 'volume_create_manager' (e5a2ffc9-1c71-4b67-9088-251ffa494d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:43:02 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-445d28e0-a146-4592-9b05-e564c26aab49 tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d315f15-fd7a-47a4-86a7-23d9cfdbdd93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:02 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-445d28e0-a146-4592-9b05-e564c26aab49 tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d315f15-fd7a-47a4-86a7-23d9cfdbdd93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-686267554',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=63acd85e-810a-41d5-b126-290e2b2baf4c,host='devstack@QuobyteHD#QuobyteHD',id=2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e1e121bb1f4469b9c38572b5eafe4ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:43:02Z,use_quota=True,user_id='ce45ee3e0a5848dea508be3d13e513bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4147cb70-5620-4974-aa03-320ec81ca989),volume_type_id=4147cb70-5620-4974-aa03-320ec81ca989)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:02 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-445d28e0-a146-4592-9b05-e564c26aab49 tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b538c97-01e1-465d-9de4-9ebb5e2622d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:02 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-445d28e0-a146-4592-9b05-e564c26aab49 tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b538c97-01e1-465d-9de4-9ebb5e2622d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:02 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-445d28e0-a146-4592-9b05-e564c26aab49 tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e442f38-7a70-409f-8eb2-f4d4b704a186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:02 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-445d28e0-a146-4592-9b05-e564c26aab49 tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e442f38-7a70-409f-8eb2-f4d4b704a186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27', 'volume_name': 'volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:02 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-445d28e0-a146-4592-9b05-e564c26aab49 tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f70c08-9f4a-4da7-8c3b-7e08c6996ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:02 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-445d28e0-a146-4592-9b05-e564c26aab49 tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f70c08-9f4a-4da7-8c3b-7e08c6996ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:02 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-445d28e0-a146-4592-9b05-e564c26aab49 tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9d615fc-7e9c-4921-bd57-b0a21aaf8447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:02 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-445d28e0-a146-4592-9b05-e564c26aab49 tempest-GroupSnapshotsTest-1988525138 None] Volume 2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27', 'volume_size': 1}
Feb 28 04:43:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-445d28e0-a146-4592-9b05-e564c26aab49 tempest-GroupSnapshotsTest-1988525138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:43:02 devstack sudo[86742]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dc88d8b2-b170-4d3f-bfab-a97054291efe tempest-SnapshotsActionsTest-1355677458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.63c6c7f9-db50-4fe6-a592-fbf09558a0be" returned: 0 in 0.901s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:02 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-dc88d8b2-b170-4d3f-bfab-a97054291efe tempest-SnapshotsActionsTest-1355677458 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.63c6c7f9-db50-4fe6-a592-fbf09558a0be is being set with open permissions: ugo+rw
Feb 28 04:43:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dc88d8b2-b170-4d3f-bfab-a97054291efe tempest-SnapshotsActionsTest-1355677458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.63c6c7f9-db50-4fe6-a592-fbf09558a0be {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:02 devstack sudo[86749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.63c6c7f9-db50-4fe6-a592-fbf09558a0be
Feb 28 04:43:02 devstack sudo[86749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:02 devstack sudo[86744]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_69qfse7kdevstack@QuobyteHD" returned: 0 in 0.955s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:02 devstack cinder-volume[84248]: DEBUG cinder.image.image_utils [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] 2c3eb214-ef72-4569-9890-199b020755f9 was qcow2, converting to raw {{(pid=84248) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Feb 28 04:43:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_69qfse7kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f8e0796a-39b2-4dc1-b3c9-d019f0196d52 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:02 devstack sudo[86754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_69qfse7kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f8e0796a-39b2-4dc1-b3c9-d019f0196d52
Feb 28 04:43:02 devstack sudo[86754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:03 devstack sudo[86749]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dc88d8b2-b170-4d3f-bfab-a97054291efe tempest-SnapshotsActionsTest-1355677458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.63c6c7f9-db50-4fe6-a592-fbf09558a0be" returned: 0 in 0.474s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-dc88d8b2-b170-4d3f-bfab-a97054291efe tempest-SnapshotsActionsTest-1355677458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.781s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:43:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-445d28e0-a146-4592-9b05-e564c26aab49 tempest-GroupSnapshotsTest-1988525138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.657s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:43:03 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-445d28e0-a146-4592-9b05-e564c26aab49 tempest-GroupSnapshotsTest-1988525138 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=63acd85e-810a-41d5-b126-290e2b2baf4c,created_at=2026-02-28T03:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-686267554',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=63acd85e-810a-41d5-b126-290e2b2baf4c,host='devstack@QuobyteHD#QuobyteHD',id=2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e1e121bb1f4469b9c38572b5eafe4ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:43:02Z,use_quota=True,user_id='ce45ee3e0a5848dea508be3d13e513bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4147cb70-5620-4974-aa03-320ec81ca989),volume_type_id=4147cb70-5620-4974-aa03-320ec81ca989)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:43:03 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-445d28e0-a146-4592-9b05-e564c26aab49 tempest-GroupSnapshotsTest-1988525138 None] Creating volume 2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:43:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-445d28e0-a146-4592-9b05-e564c26aab49 tempest-GroupSnapshotsTest-1988525138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:43:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-445d28e0-a146-4592-9b05-e564c26aab49 tempest-GroupSnapshotsTest-1988525138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:43:03 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-445d28e0-a146-4592-9b05-e564c26aab49 tempest-GroupSnapshotsTest-1988525138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:43:03 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-445d28e0-a146-4592-9b05-e564c26aab49 tempest-GroupSnapshotsTest-1988525138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:43:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-445d28e0-a146-4592-9b05-e564c26aab49 tempest-GroupSnapshotsTest-1988525138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:43:03 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-445d28e0-a146-4592-9b05-e564c26aab49 tempest-GroupSnapshotsTest-1988525138 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:43:03 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-445d28e0-a146-4592-9b05-e564c26aab49 tempest-GroupSnapshotsTest-1988525138 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:43:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-445d28e0-a146-4592-9b05-e564c26aab49 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:03 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-dc88d8b2-b170-4d3f-bfab-a97054291efe tempest-SnapshotsActionsTest-1355677458 None] Create snapshot completed successfully
Feb 28 04:43:03 devstack sudo[86758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27 1073741824
Feb 28 04:43:03 devstack sudo[86758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:04 devstack sudo[86754]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_69qfse7kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f8e0796a-39b2-4dc1-b3c9-d019f0196d52" returned: 0 in 1.105s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:04 devstack cinder-volume[84248]: DEBUG cinder.image.image_utils [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_69qfse7kdevstack@QuobyteHD, size 112.00 MB, duration 1.11 sec, destination /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f8e0796a-39b2-4dc1-b3c9-d019f0196d52 {{(pid=84248) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 28 04:43:04 devstack cinder-volume[84248]: INFO cinder.image.image_utils [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Converted 112.00 MB image at 101.00 MB/s
Feb 28 04:43:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f8e0796a-39b2-4dc1-b3c9-d019f0196d52 1G {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:04 devstack sudo[86758]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-445d28e0-a146-4592-9b05-e564c26aab49 tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27 1073741824" returned: 0 in 0.758s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:04 devstack sudo[86768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f8e0796a-39b2-4dc1-b3c9-d019f0196d52 1G
Feb 28 04:43:04 devstack sudo[86768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:04 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-6b5a63bb-0cb5-4527-a7da-8d40b481ab8f tempest-GroupSnapshotsV319Test-509011177 None] Group tempest-GroupSnapshotsV319Test-Group-1844279780: creating
Feb 28 04:43:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-445d28e0-a146-4592-9b05-e564c26aab49 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:04 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-6b5a63bb-0cb5-4527-a7da-8d40b481ab8f tempest-GroupSnapshotsV319Test-509011177 None] Group tempest-GroupSnapshotsV319Test-Group-1844279780: created successfully
Feb 28 04:43:04 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-6b5a63bb-0cb5-4527-a7da-8d40b481ab8f tempest-GroupSnapshotsV319Test-509011177 None] Create group completed successfully.
Feb 28 04:43:04 devstack sudo[86770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27
Feb 28 04:43:04 devstack sudo[86770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:04 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8da7d145-f7c2-47c1-813f-ae2970d935ac tempest-SnapshotsActionsTest-1818712012 None] Acquiring lock "cinder-63c6c7f9-db50-4fe6-a592-fbf09558a0be-delete_snapshot" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:43:04 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8da7d145-f7c2-47c1-813f-ae2970d935ac tempest-SnapshotsActionsTest-1818712012 None] Lock "cinder-63c6c7f9-db50-4fe6-a592-fbf09558a0be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:43:04 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8da7d145-f7c2-47c1-813f-ae2970d935ac tempest-SnapshotsActionsTest-1818712012 None] Acquiring lock "cinder-quobyte-0a27a465-7230-4e68-9540-285c134cf1c5" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:43:04 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8da7d145-f7c2-47c1-813f-ae2970d935ac tempest-SnapshotsActionsTest-1818712012 None] Lock "cinder-quobyte-0a27a465-7230-4e68-9540-285c134cf1c5" acquired by "delete_snapshot" :: waited 0.011s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:43:04 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8da7d145-f7c2-47c1-813f-ae2970d935ac tempest-SnapshotsActionsTest-1818712012 None] Acquiring lock "cinder-quobyte-63c6c7f9-db50-4fe6-a592-fbf09558a0be" by "_delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:43:04 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8da7d145-f7c2-47c1-813f-ae2970d935ac tempest-SnapshotsActionsTest-1818712012 None] Lock "cinder-quobyte-63c6c7f9-db50-4fe6-a592-fbf09558a0be" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:43:04 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-8da7d145-f7c2-47c1-813f-ae2970d935ac tempest-SnapshotsActionsTest-1818712012 None] Deleting offline snapshot 63c6c7f9-db50-4fe6-a592-fbf09558a0be of volume 0a27a465-7230-4e68-9540-285c134cf1c5 {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 04:43:04 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-8da7d145-f7c2-47c1-813f-ae2970d935ac tempest-SnapshotsActionsTest-1818712012 None] snapshot_file for this snap is: volume-0a27a465-7230-4e68-9540-285c134cf1c5.63c6c7f9-db50-4fe6-a592-fbf09558a0be {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 04:43:04 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9ae651-85a0-436d-b7f5-2dbdbe06b7ca]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:43:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8da7d145-f7c2-47c1-813f-ae2970d935ac tempest-SnapshotsActionsTest-1818712012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.63c6c7f9-db50-4fe6-a592-fbf09558a0be {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:04 devstack sudo[86772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.63c6c7f9-db50-4fe6-a592-fbf09558a0be
Feb 28 04:43:04 devstack sudo[86772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:04 devstack sudo[86768]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f8e0796a-39b2-4dc1-b3c9-d019f0196d52 1G" returned: 0 in 0.470s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:04 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[556c042b-47fa-452d-82b0-e3b834297f84]: (4, 'raw') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:43:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f8e0796a-39b2-4dc1-b3c9-d019f0196d52 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:04 devstack sudo[86777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f8e0796a-39b2-4dc1-b3c9-d019f0196d52
Feb 28 04:43:04 devstack sudo[86777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:04 devstack sudo[86770]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-445d28e0-a146-4592-9b05-e564c26aab49 tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27" returned: 0 in 0.535s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:04 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-445d28e0-a146-4592-9b05-e564c26aab49 tempest-GroupSnapshotsTest-1988525138 None] <== create_volume: return (1389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:43:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-445d28e0-a146-4592-9b05-e564c26aab49 tempest-GroupSnapshotsTest-1988525138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.391s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:43:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-445d28e0-a146-4592-9b05-e564c26aab49 tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9d615fc-7e9c-4921-bd57-b0a21aaf8447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-445d28e0-a146-4592-9b05-e564c26aab49 tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9a0a87d-d3c8-499a-9d93-c0aaf8cc2596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:04 devstack cinder-volume[84248]: DEBUG dbcounter [-] [84248] Writing DB stats cinder:SELECT=115,cinder:INSERT=30,cinder:UPDATE=100,cinder:DELETE=12 {{(pid=84248) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 04:43:04 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-445d28e0-a146-4592-9b05-e564c26aab49 tempest-GroupSnapshotsTest-1988525138 None] Volume volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27 (2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27): created successfully
Feb 28 04:43:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-445d28e0-a146-4592-9b05-e564c26aab49 tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9a0a87d-d3c8-499a-9d93-c0aaf8cc2596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-445d28e0-a146-4592-9b05-e564c26aab49 tempest-GroupSnapshotsTest-1988525138 None] Flow 'volume_create_manager' (e5a2ffc9-1c71-4b67-9088-251ffa494d3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:43:04 devstack cinder-volume[84248]: DEBUG dbcounter [-] [84248] Writing DB stats cinder:UPDATE=146,cinder:SELECT=121,cinder:INSERT=26,cinder:DELETE=4 {{(pid=84248) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 04:43:04 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-445d28e0-a146-4592-9b05-e564c26aab49 tempest-GroupSnapshotsTest-1988525138 None] Created volume successfully.
Feb 28 04:43:04 devstack sudo[86772]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8da7d145-f7c2-47c1-813f-ae2970d935ac tempest-SnapshotsActionsTest-1818712012 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.63c6c7f9-db50-4fe6-a592-fbf09558a0be" returned: 0 in 0.583s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:04 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-8da7d145-f7c2-47c1-813f-ae2970d935ac tempest-SnapshotsActionsTest-1818712012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a27a465-7230-4e68-9540-285c134cf1c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:43:04 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[282a23c5-9857-4f82-bcee-ba990bd3243c]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:43:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8da7d145-f7c2-47c1-813f-ae2970d935ac tempest-SnapshotsActionsTest-1818712012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:05 devstack sudo[86783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc
Feb 28 04:43:05 devstack sudo[86783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:05 devstack sudo[86777]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f8e0796a-39b2-4dc1-b3c9-d019f0196d52" returned: 0 in 0.608s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f8e0796a-39b2-4dc1-b3c9-d019f0196d52 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:05 devstack sudo[86787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f8e0796a-39b2-4dc1-b3c9-d019f0196d52
Feb 28 04:43:05 devstack sudo[86787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:05 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-38f4981c-0066-4d17-8d84-f45b43ee152e tempest-GroupSnapshotsV319Test-509011177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:43:05 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-38f4981c-0066-4d17-8d84-f45b43ee152e tempest-GroupSnapshotsV319Test-509011177 None] Flow 'volume_create_manager' (b403b6f5-af8a-4c7a-b07a-4c0ad9267395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:43:05 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-38f4981c-0066-4d17-8d84-f45b43ee152e tempest-GroupSnapshotsV319Test-509011177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cee050a4-aa08-44ea-91d7-d54306e81fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:05 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-38f4981c-0066-4d17-8d84-f45b43ee152e tempest-GroupSnapshotsV319Test-509011177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cee050a4-aa08-44ea-91d7-d54306e81fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-80360359',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0134f03e-3621-4e11-b842-43e17595e4d5,host='devstack@QuobyteHD#QuobyteHD',id=6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73f34d12eca04d12bb9ea00db252afe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:43:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:43:05Z,use_quota=True,user_id='0f7268391ae24896b3867afe4ac879e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4ae3bbd-55e4-43dd-add6-cf3bdafb6569),volume_type_id=d4ae3bbd-55e4-43dd-add6-cf3bdafb6569)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:05 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-38f4981c-0066-4d17-8d84-f45b43ee152e tempest-GroupSnapshotsV319Test-509011177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2990428c-442a-4d0e-a9a0-c12afc3e1001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:05 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-38f4981c-0066-4d17-8d84-f45b43ee152e tempest-GroupSnapshotsV319Test-509011177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2990428c-442a-4d0e-a9a0-c12afc3e1001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:05 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-38f4981c-0066-4d17-8d84-f45b43ee152e tempest-GroupSnapshotsV319Test-509011177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43db184d-1d70-405a-b3e5-126274a2ed8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:05 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-38f4981c-0066-4d17-8d84-f45b43ee152e tempest-GroupSnapshotsV319Test-509011177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43db184d-1d70-405a-b3e5-126274a2ed8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6', 'volume_name': 'volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:05 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-38f4981c-0066-4d17-8d84-f45b43ee152e tempest-GroupSnapshotsV319Test-509011177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a505b194-023c-4fb3-9b5c-d92b3dff1cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:05 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-38f4981c-0066-4d17-8d84-f45b43ee152e tempest-GroupSnapshotsV319Test-509011177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a505b194-023c-4fb3-9b5c-d92b3dff1cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:05 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-38f4981c-0066-4d17-8d84-f45b43ee152e tempest-GroupSnapshotsV319Test-509011177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ad808b2-88ab-4ad1-beef-e1503b1cded6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:05 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-38f4981c-0066-4d17-8d84-f45b43ee152e tempest-GroupSnapshotsV319Test-509011177 None] Volume 6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6', 'volume_size': 1}
Feb 28 04:43:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-38f4981c-0066-4d17-8d84-f45b43ee152e tempest-GroupSnapshotsV319Test-509011177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:43:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-38f4981c-0066-4d17-8d84-f45b43ee152e tempest-GroupSnapshotsV319Test-509011177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:43:05 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-38f4981c-0066-4d17-8d84-f45b43ee152e tempest-GroupSnapshotsV319Test-509011177 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=0134f03e-3621-4e11-b842-43e17595e4d5,created_at=2026-02-28T03:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-80360359',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0134f03e-3621-4e11-b842-43e17595e4d5,host='devstack@QuobyteHD#QuobyteHD',id=6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73f34d12eca04d12bb9ea00db252afe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:43:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:43:05Z,use_quota=True,user_id='0f7268391ae24896b3867afe4ac879e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4ae3bbd-55e4-43dd-add6-cf3bdafb6569),volume_type_id=d4ae3bbd-55e4-43dd-add6-cf3bdafb6569)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:43:05 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-38f4981c-0066-4d17-8d84-f45b43ee152e tempest-GroupSnapshotsV319Test-509011177 None] Creating volume 6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:43:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-38f4981c-0066-4d17-8d84-f45b43ee152e tempest-GroupSnapshotsV319Test-509011177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:43:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-38f4981c-0066-4d17-8d84-f45b43ee152e tempest-GroupSnapshotsV319Test-509011177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:43:05 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-38f4981c-0066-4d17-8d84-f45b43ee152e tempest-GroupSnapshotsV319Test-509011177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:43:05 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-38f4981c-0066-4d17-8d84-f45b43ee152e tempest-GroupSnapshotsV319Test-509011177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:43:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-38f4981c-0066-4d17-8d84-f45b43ee152e tempest-GroupSnapshotsV319Test-509011177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:43:05 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-38f4981c-0066-4d17-8d84-f45b43ee152e tempest-GroupSnapshotsV319Test-509011177 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:43:05 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-38f4981c-0066-4d17-8d84-f45b43ee152e tempest-GroupSnapshotsV319Test-509011177 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:43:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-38f4981c-0066-4d17-8d84-f45b43ee152e tempest-GroupSnapshotsV319Test-509011177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:05 devstack sudo[86783]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8da7d145-f7c2-47c1-813f-ae2970d935ac tempest-SnapshotsActionsTest-1818712012 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc" returned: 0 in 0.621s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:05 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-8da7d145-f7c2-47c1-813f-ae2970d935ac tempest-SnapshotsActionsTest-1818712012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a27a465-7230-4e68-9540-285c134cf1c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:43:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8da7d145-f7c2-47c1-813f-ae2970d935ac tempest-SnapshotsActionsTest-1818712012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.63c6c7f9-db50-4fe6-a592-fbf09558a0be {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:05 devstack sudo[86792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6 1073741824
Feb 28 04:43:05 devstack sudo[86792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:05 devstack sudo[86793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.63c6c7f9-db50-4fe6-a592-fbf09558a0be
Feb 28 04:43:05 devstack sudo[86793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:05 devstack sudo[86787]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f8e0796a-39b2-4dc1-b3c9-d019f0196d52" returned: 1 in 0.618s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f8e0796a-39b2-4dc1-b3c9-d019f0196d52' failed. Not Retrying. {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 28 04:43:05 devstack cinder-volume[84248]: DEBUG cinder.volume.volume_utils [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Downloaded image 2c3eb214-ef72-4569-9890-199b020755f9 ((None, [{'url': 'file:///opt/stack/data/glance/images/2c3eb214-ef72-4569-9890-199b020755f9', 'metadata': {}}])) to volume f8e0796a-39b2-4dc1-b3c9-d019f0196d52 successfully. {{(pid=84248) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Feb 28 04:43:05 devstack cinder-volume[84248]: DEBUG cinder.image.image_utils [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Temporary image 2c3eb214-ef72-4569-9890-199b020755f9 for user 62168aa8c3fd406f8acc081b76e769a6 is deleted. {{(pid=84248) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Feb 28 04:43:05 devstack cinder-volume[84248]: DEBUG cinder.volume.volume_utils [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Marking volume f8e0796a-39b2-4dc1-b3c9-d019f0196d52 as bootable. {{(pid=84248) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Feb 28 04:43:05 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Copying metadata from image 2c3eb214-ef72-4569-9890-199b020755f9 to f8e0796a-39b2-4dc1-b3c9-d019f0196d52. {{(pid=84248) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Feb 28 04:43:05 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Creating volume glance metadata for volume f8e0796a-39b2-4dc1-b3c9-d019f0196d52 backed by image 2c3eb214-ef72-4569-9890-199b020755f9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2c3eb214-ef72-4569-9890-199b020755f9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84248) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Feb 28 04:43:05 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85b27dd8-a34c-4d31-bfcd-6be6be8e2b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8e0796a-39b2-4dc1-b3c9-d019f0196d52', 'volume_size': 1, 'image_id': '2c3eb214-ef72-4569-9890-199b020755f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2c3eb214-ef72-4569-9890-199b020755f9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c0fde1a75874ab3961d0c965899b1f4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2c3eb214-ef72-4569-9890-199b020755f9', 'created_at': datetime.datetime(2026, 2, 28, 3, 36, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 28, 3, 36, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2c3eb214-ef72-4569-9890-199b020755f9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5e40162f50>}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:05 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (774c859c-14c0-4dc3-bb1b-50250dc8403b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:05 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Volume volume-f8e0796a-39b2-4dc1-b3c9-d019f0196d52 (f8e0796a-39b2-4dc1-b3c9-d019f0196d52): created successfully
Feb 28 04:43:05 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (774c859c-14c0-4dc3-bb1b-50250dc8403b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:05 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Flow 'volume_create_manager' (29d5aacb-220e-4f3b-b2a9-c7125e2beaa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:43:05 devstack cinder-volume[84248]: INFO cinder.volume.manager [req-879f03a9-5545-49fd-8499-12d625d4529d req-fb5b6b67-651a-41cb-a4d7-cdbd79b259a4 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Created volume successfully.
Feb 28 04:43:06 devstack sudo[86792]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-38f4981c-0066-4d17-8d84-f45b43ee152e tempest-GroupSnapshotsV319Test-509011177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6 1073741824" returned: 0 in 0.608s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-38f4981c-0066-4d17-8d84-f45b43ee152e tempest-GroupSnapshotsV319Test-509011177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:06 devstack sudo[86805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6
Feb 28 04:43:06 devstack sudo[86805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:06 devstack sudo[86793]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8da7d145-f7c2-47c1-813f-ae2970d935ac tempest-SnapshotsActionsTest-1818712012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.63c6c7f9-db50-4fe6-a592-fbf09558a0be" returned: 0 in 0.687s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8da7d145-f7c2-47c1-813f-ae2970d935ac tempest-SnapshotsActionsTest-1818712012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.63c6c7f9-db50-4fe6-a592-fbf09558a0be {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:06 devstack sudo[86807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.63c6c7f9-db50-4fe6-a592-fbf09558a0be
Feb 28 04:43:06 devstack sudo[86807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:06 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-27293196-d8b4-4b3f-994c-43fc10cc8dc9 tempest-GroupSnapshotsTest-1988525138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:43:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-27293196-d8b4-4b3f-994c-43fc10cc8dc9 tempest-GroupSnapshotsTest-1988525138 None] Flow 'volume_create_manager' (1ae123fe-3348-4507-a972-1e6b7cd7dbd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:43:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-27293196-d8b4-4b3f-994c-43fc10cc8dc9 tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28226672-882f-4068-a66b-fafd3ef5c793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-27293196-d8b4-4b3f-994c-43fc10cc8dc9 tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28226672-882f-4068-a66b-fafd3ef5c793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:43:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1722017279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=63acd85e-810a-41d5-b126-290e2b2baf4c,host='devstack@QuobyteHD#QuobyteHD',id=a7913619-1daf-46ed-85c1-1703d6a97298,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e1e121bb1f4469b9c38572b5eafe4ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:43:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:43:06Z,use_quota=True,user_id='ce45ee3e0a5848dea508be3d13e513bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4147cb70-5620-4974-aa03-320ec81ca989),volume_type_id=4147cb70-5620-4974-aa03-320ec81ca989)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-27293196-d8b4-4b3f-994c-43fc10cc8dc9 tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ec81b35-8020-48bc-a382-daa5abbd78c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-27293196-d8b4-4b3f-994c-43fc10cc8dc9 tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ec81b35-8020-48bc-a382-daa5abbd78c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-27293196-d8b4-4b3f-994c-43fc10cc8dc9 tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73b244bc-a305-4b51-a436-c8354aba7c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-27293196-d8b4-4b3f-994c-43fc10cc8dc9 tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73b244bc-a305-4b51-a436-c8354aba7c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7913619-1daf-46ed-85c1-1703d6a97298', 'volume_name': 'volume-a7913619-1daf-46ed-85c1-1703d6a97298', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-27293196-d8b4-4b3f-994c-43fc10cc8dc9 tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c2dc4fd-125b-469c-afe9-88155345d59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-27293196-d8b4-4b3f-994c-43fc10cc8dc9 tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c2dc4fd-125b-469c-afe9-88155345d59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-27293196-d8b4-4b3f-994c-43fc10cc8dc9 tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb05dece-b257-43e0-83ee-e65f3a60296c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:06 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-27293196-d8b4-4b3f-994c-43fc10cc8dc9 tempest-GroupSnapshotsTest-1988525138 None] Volume a7913619-1daf-46ed-85c1-1703d6a97298: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7913619-1daf-46ed-85c1-1703d6a97298', 'volume_size': 1}
Feb 28 04:43:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-27293196-d8b4-4b3f-994c-43fc10cc8dc9 tempest-GroupSnapshotsTest-1988525138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:43:06 devstack sudo[86805]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-38f4981c-0066-4d17-8d84-f45b43ee152e tempest-GroupSnapshotsV319Test-509011177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6" returned: 0 in 0.489s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:06 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-38f4981c-0066-4d17-8d84-f45b43ee152e tempest-GroupSnapshotsV319Test-509011177 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:43:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-38f4981c-0066-4d17-8d84-f45b43ee152e tempest-GroupSnapshotsV319Test-509011177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:43:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-27293196-d8b4-4b3f-994c-43fc10cc8dc9 tempest-GroupSnapshotsTest-1988525138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.194s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:43:06 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-27293196-d8b4-4b3f-994c-43fc10cc8dc9 tempest-GroupSnapshotsTest-1988525138 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=63acd85e-810a-41d5-b126-290e2b2baf4c,created_at=2026-02-28T03:43:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1722017279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=63acd85e-810a-41d5-b126-290e2b2baf4c,host='devstack@QuobyteHD#QuobyteHD',id=a7913619-1daf-46ed-85c1-1703d6a97298,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e1e121bb1f4469b9c38572b5eafe4ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:43:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:43:06Z,use_quota=True,user_id='ce45ee3e0a5848dea508be3d13e513bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4147cb70-5620-4974-aa03-320ec81ca989),volume_type_id=4147cb70-5620-4974-aa03-320ec81ca989)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:43:06 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-27293196-d8b4-4b3f-994c-43fc10cc8dc9 tempest-GroupSnapshotsTest-1988525138 None] Creating volume a7913619-1daf-46ed-85c1-1703d6a97298 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:43:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-27293196-d8b4-4b3f-994c-43fc10cc8dc9 tempest-GroupSnapshotsTest-1988525138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:43:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-27293196-d8b4-4b3f-994c-43fc10cc8dc9 tempest-GroupSnapshotsTest-1988525138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:43:06 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-27293196-d8b4-4b3f-994c-43fc10cc8dc9 tempest-GroupSnapshotsTest-1988525138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:43:06 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-27293196-d8b4-4b3f-994c-43fc10cc8dc9 tempest-GroupSnapshotsTest-1988525138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:43:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-27293196-d8b4-4b3f-994c-43fc10cc8dc9 tempest-GroupSnapshotsTest-1988525138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:43:06 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-27293196-d8b4-4b3f-994c-43fc10cc8dc9 tempest-GroupSnapshotsTest-1988525138 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:43:06 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-27293196-d8b4-4b3f-994c-43fc10cc8dc9 tempest-GroupSnapshotsTest-1988525138 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:43:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-27293196-d8b4-4b3f-994c-43fc10cc8dc9 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-38f4981c-0066-4d17-8d84-f45b43ee152e tempest-GroupSnapshotsV319Test-509011177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ad808b2-88ab-4ad1-beef-e1503b1cded6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:06 devstack sudo[86811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298 1073741824
Feb 28 04:43:06 devstack sudo[86811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:06 devstack sudo[86807]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-38f4981c-0066-4d17-8d84-f45b43ee152e tempest-GroupSnapshotsV319Test-509011177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbaefdff-52ca-49d2-ad60-c15916f03ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8da7d145-f7c2-47c1-813f-ae2970d935ac tempest-SnapshotsActionsTest-1818712012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.63c6c7f9-db50-4fe6-a592-fbf09558a0be" returned: 0 in 0.462s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:06 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-38f4981c-0066-4d17-8d84-f45b43ee152e tempest-GroupSnapshotsV319Test-509011177 None] Volume volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6 (6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6): created successfully
Feb 28 04:43:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-38f4981c-0066-4d17-8d84-f45b43ee152e tempest-GroupSnapshotsV319Test-509011177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbaefdff-52ca-49d2-ad60-c15916f03ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-38f4981c-0066-4d17-8d84-f45b43ee152e tempest-GroupSnapshotsV319Test-509011177 None] Flow 'volume_create_manager' (b403b6f5-af8a-4c7a-b07a-4c0ad9267395) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:43:06 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8da7d145-f7c2-47c1-813f-ae2970d935ac tempest-SnapshotsActionsTest-1818712012 None] Lock "cinder-quobyte-63c6c7f9-db50-4fe6-a592-fbf09558a0be" released by "_delete_snapshot" :: held 2.422s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:43:06 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8da7d145-f7c2-47c1-813f-ae2970d935ac tempest-SnapshotsActionsTest-1818712012 None] Lock "cinder-quobyte-0a27a465-7230-4e68-9540-285c134cf1c5" released by "delete_snapshot" :: held 2.435s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:43:06 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-38f4981c-0066-4d17-8d84-f45b43ee152e tempest-GroupSnapshotsV319Test-509011177 None] Created volume successfully.
Feb 28 04:43:06 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-8da7d145-f7c2-47c1-813f-ae2970d935ac tempest-SnapshotsActionsTest-1818712012 None] Created reservations ['05b2dd3b-05ad-4a2a-834d-f0c8d1ecaa7c', 'ecab2a0b-44a3-41e3-b75d-b7b6ccbbfdfc', '6d60da20-5d2c-4224-8a18-d07545adecba', '4b5eadd1-adb5-402d-a9d7-85a5969f6619'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:43:06 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-8da7d145-f7c2-47c1-813f-ae2970d935ac tempest-SnapshotsActionsTest-1818712012 None] Delete snapshot completed successfully.
Feb 28 04:43:06 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8da7d145-f7c2-47c1-813f-ae2970d935ac tempest-SnapshotsActionsTest-1818712012 None] Lock "cinder-63c6c7f9-db50-4fe6-a592-fbf09558a0be-delete_snapshot" released by "delete_snapshot" :: held 2.531s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:43:07 devstack sudo[86811]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-27293196-d8b4-4b3f-994c-43fc10cc8dc9 tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298 1073741824" returned: 0 in 0.489s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-27293196-d8b4-4b3f-994c-43fc10cc8dc9 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:07 devstack sudo[86816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298
Feb 28 04:43:07 devstack sudo[86816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:07 devstack sudo[86816]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-27293196-d8b4-4b3f-994c-43fc10cc8dc9 tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298" returned: 0 in 0.391s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:07 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-27293196-d8b4-4b3f-994c-43fc10cc8dc9 tempest-GroupSnapshotsTest-1988525138 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:43:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-27293196-d8b4-4b3f-994c-43fc10cc8dc9 tempest-GroupSnapshotsTest-1988525138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:43:07 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-27293196-d8b4-4b3f-994c-43fc10cc8dc9 tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb05dece-b257-43e0-83ee-e65f3a60296c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7913619-1daf-46ed-85c1-1703d6a97298', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:07 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-27293196-d8b4-4b3f-994c-43fc10cc8dc9 tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db901ea2-d43f-4739-b985-75c0dc47a71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:07 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-27293196-d8b4-4b3f-994c-43fc10cc8dc9 tempest-GroupSnapshotsTest-1988525138 None] Volume volume-a7913619-1daf-46ed-85c1-1703d6a97298 (a7913619-1daf-46ed-85c1-1703d6a97298): created successfully
Feb 28 04:43:07 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-27293196-d8b4-4b3f-994c-43fc10cc8dc9 tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db901ea2-d43f-4739-b985-75c0dc47a71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:07 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-27293196-d8b4-4b3f-994c-43fc10cc8dc9 tempest-GroupSnapshotsTest-1988525138 None] Flow 'volume_create_manager' (1ae123fe-3348-4507-a972-1e6b7cd7dbd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:43:07 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-27293196-d8b4-4b3f-994c-43fc10cc8dc9 tempest-GroupSnapshotsTest-1988525138 None] Created volume successfully.
Feb 28 04:43:07 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-e84936ea-93db-4919-8a04-a8dfa0c5e176 tempest-GroupSnapshotsV319Test-509011177 None] GroupSnapshot c57a1c60-64f8-4f3c-bb4a-c1d0630ccdb9: creating.
Feb 28 04:43:07 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e84936ea-93db-4919-8a04-a8dfa0c5e176 tempest-GroupSnapshotsV319Test-509011177 None] Group snapshot c57a1c60-64f8-4f3c-bb4a-c1d0630ccdb9: creating. {{(pid=84248) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Feb 28 04:43:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e84936ea-93db-4919-8a04-a8dfa0c5e176 tempest-GroupSnapshotsV319Test-509011177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:43:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e84936ea-93db-4919-8a04-a8dfa0c5e176 tempest-GroupSnapshotsV319Test-509011177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:43:07 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-e84936ea-93db-4919-8a04-a8dfa0c5e176 tempest-GroupSnapshotsV319Test-509011177 None] Creating offline snapshot cf1c2320-a980-498b-baa5-95238e15b24e of volume 6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6 {{(pid=84248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 04:43:07 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[6618783b-97ed-47d1-aa13-28c633146c30]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:43:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e84936ea-93db-4919-8a04-a8dfa0c5e176 tempest-GroupSnapshotsV319Test-509011177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3e2549ed-8703-4e94-a36a-a03ddae11eb7 tempest-SnapshotsActionsTest-1355677458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:43:07 devstack sudo[86819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6
Feb 28 04:43:07 devstack sudo[86819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:08 devstack sudo[86819]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e84936ea-93db-4919-8a04-a8dfa0c5e176 tempest-GroupSnapshotsV319Test-509011177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6" returned: 0 in 0.462s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e84936ea-93db-4919-8a04-a8dfa0c5e176 tempest-GroupSnapshotsV319Test-509011177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6.cf1c2320-a980-498b-baa5-95238e15b24e 1G {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:08 devstack sudo[86824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6.cf1c2320-a980-498b-baa5-95238e15b24e 1G
Feb 28 04:43:08 devstack sudo[86824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-879f03a9-5545-49fd-8499-12d625d4529d req-03f3d740-f526-4685-9be6-99447395afeb tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:43:08 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-b5bb81d6-8f10-4365-9533-2e9acc9b7d79 tempest-GroupSnapshotsTest-1988525138 None] Update group completed successfully.
Feb 28 04:43:08 devstack sudo[86824]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e84936ea-93db-4919-8a04-a8dfa0c5e176 tempest-GroupSnapshotsV319Test-509011177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6.cf1c2320-a980-498b-baa5-95238e15b24e 1G" returned: 0 in 0.605s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e84936ea-93db-4919-8a04-a8dfa0c5e176 tempest-GroupSnapshotsV319Test-509011177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6.cf1c2320-a980-498b-baa5-95238e15b24e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:08 devstack sudo[86837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6.cf1c2320-a980-498b-baa5-95238e15b24e
Feb 28 04:43:08 devstack sudo[86837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:09 devstack sudo[86837]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:09 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e84936ea-93db-4919-8a04-a8dfa0c5e176 tempest-GroupSnapshotsV319Test-509011177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6.cf1c2320-a980-498b-baa5-95238e15b24e" returned: 0 in 0.417s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:09 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-e84936ea-93db-4919-8a04-a8dfa0c5e176 tempest-GroupSnapshotsV319Test-509011177 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6.cf1c2320-a980-498b-baa5-95238e15b24e is being set with open permissions: ugo+rw: NotImplementedError
Feb 28 04:43:09 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e84936ea-93db-4919-8a04-a8dfa0c5e176 tempest-GroupSnapshotsV319Test-509011177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6.cf1c2320-a980-498b-baa5-95238e15b24e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:09 devstack sudo[86842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6.cf1c2320-a980-498b-baa5-95238e15b24e
Feb 28 04:43:09 devstack sudo[86842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:09 devstack sudo[86842]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:09 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e84936ea-93db-4919-8a04-a8dfa0c5e176 tempest-GroupSnapshotsV319Test-509011177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6.cf1c2320-a980-498b-baa5-95238e15b24e" returned: 0 in 0.418s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:09 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e84936ea-93db-4919-8a04-a8dfa0c5e176 tempest-GroupSnapshotsV319Test-509011177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:09 devstack sudo[86846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6.info
Feb 28 04:43:09 devstack sudo[86846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:09 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-c6758900-a702-4a95-92c4-dc01d46b66be tempest-GroupSnapshotsTest-1988525138 None] Update group completed successfully.
Feb 28 04:43:10 devstack sudo[86846]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e84936ea-93db-4919-8a04-a8dfa0c5e176 tempest-GroupSnapshotsV319Test-509011177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6.info" returned: 0 in 0.432s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:10 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-e84936ea-93db-4919-8a04-a8dfa0c5e176 tempest-GroupSnapshotsV319Test-509011177 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6.info is being set with open permissions: ugo+rw: NotImplementedError
Feb 28 04:43:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e84936ea-93db-4919-8a04-a8dfa0c5e176 tempest-GroupSnapshotsV319Test-509011177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:10 devstack sudo[86849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6.info
Feb 28 04:43:10 devstack sudo[86849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:10 devstack sudo[86849]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e84936ea-93db-4919-8a04-a8dfa0c5e176 tempest-GroupSnapshotsV319Test-509011177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6.info" returned: 0 in 0.397s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e84936ea-93db-4919-8a04-a8dfa0c5e176 tempest-GroupSnapshotsV319Test-509011177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.808s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:43:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3e2549ed-8703-4e94-a36a-a03ddae11eb7 tempest-SnapshotsActionsTest-1355677458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.739s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:43:10 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-3e2549ed-8703-4e94-a36a-a03ddae11eb7 tempest-SnapshotsActionsTest-1355677458 None] Creating offline snapshot e500c31f-a10a-46df-9bc0-1aeb83b2b212 of volume 0a27a465-7230-4e68-9540-285c134cf1c5 {{(pid=84248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 04:43:10 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ec6183-8207-450c-b233-c50e9564d0f6]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:43:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3e2549ed-8703-4e94-a36a-a03ddae11eb7 tempest-SnapshotsActionsTest-1355677458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:10 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-e84936ea-93db-4919-8a04-a8dfa0c5e176 tempest-GroupSnapshotsV319Test-509011177 None] group_snapshot c57a1c60-64f8-4f3c-bb4a-c1d0630ccdb9: created successfully
Feb 28 04:43:10 devstack sudo[86852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc
Feb 28 04:43:10 devstack sudo[86852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:10 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-9383988a-5e3c-4a61-b72b-adb2ebb7100c tempest-GroupSnapshotsTest-1988525138 None] Update group completed successfully.
Feb 28 04:43:11 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-b692ad3c-5d95-4e01-bb56-8beb9c85b913 tempest-GroupSnapshotsTest-1988525138 None] Update group completed successfully.
Feb 28 04:43:11 devstack sudo[86852]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3e2549ed-8703-4e94-a36a-a03ddae11eb7 tempest-SnapshotsActionsTest-1355677458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc" returned: 0 in 0.581s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:11 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-3e2549ed-8703-4e94-a36a-a03ddae11eb7 tempest-SnapshotsActionsTest-1355677458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a27a465-7230-4e68-9540-285c134cf1c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:43:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3e2549ed-8703-4e94-a36a-a03ddae11eb7 tempest-SnapshotsActionsTest-1355677458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.e500c31f-a10a-46df-9bc0-1aeb83b2b212 1G {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:11 devstack sudo[86857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.e500c31f-a10a-46df-9bc0-1aeb83b2b212 1G
Feb 28 04:43:11 devstack sudo[86857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:11 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-1c2412aa-931f-454d-ab6d-d7bc8a797d95 tempest-GroupSnapshotsV319Test-509011177 None] group_snapshot c57a1c60-64f8-4f3c-bb4a-c1d0630ccdb9: deleting
Feb 28 04:43:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-1c2412aa-931f-454d-ab6d-d7bc8a797d95 tempest-GroupSnapshotsV319Test-509011177 None] group_snapshot c57a1c60-64f8-4f3c-bb4a-c1d0630ccdb9: deleting {{(pid=84248) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Feb 28 04:43:11 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1c2412aa-931f-454d-ab6d-d7bc8a797d95 tempest-GroupSnapshotsV319Test-509011177 None] Acquiring lock "cinder-quobyte-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:43:11 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1c2412aa-931f-454d-ab6d-d7bc8a797d95 tempest-GroupSnapshotsV319Test-509011177 None] Lock "cinder-quobyte-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6" acquired by "delete_snapshot" :: waited 0.008s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:43:11 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1c2412aa-931f-454d-ab6d-d7bc8a797d95 tempest-GroupSnapshotsV319Test-509011177 None] Acquiring lock "cinder-quobyte-cf1c2320-a980-498b-baa5-95238e15b24e" by "_delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:43:11 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1c2412aa-931f-454d-ab6d-d7bc8a797d95 tempest-GroupSnapshotsV319Test-509011177 None] Lock "cinder-quobyte-cf1c2320-a980-498b-baa5-95238e15b24e" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:43:11 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-1c2412aa-931f-454d-ab6d-d7bc8a797d95 tempest-GroupSnapshotsV319Test-509011177 None] Deleting offline snapshot cf1c2320-a980-498b-baa5-95238e15b24e of volume 6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6 {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 04:43:11 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-1c2412aa-931f-454d-ab6d-d7bc8a797d95 tempest-GroupSnapshotsV319Test-509011177 None] snapshot_file for this snap is: volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6.cf1c2320-a980-498b-baa5-95238e15b24e {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 04:43:11 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f2dfac-17d5-4918-b2a4-c4d83f3a6221]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:43:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1c2412aa-931f-454d-ab6d-d7bc8a797d95 tempest-GroupSnapshotsV319Test-509011177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6.cf1c2320-a980-498b-baa5-95238e15b24e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:11 devstack sudo[86859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6.cf1c2320-a980-498b-baa5-95238e15b24e
Feb 28 04:43:11 devstack sudo[86859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:11 devstack sudo[86857]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3e2549ed-8703-4e94-a36a-a03ddae11eb7 tempest-SnapshotsActionsTest-1355677458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.e500c31f-a10a-46df-9bc0-1aeb83b2b212 1G" returned: 0 in 0.529s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3e2549ed-8703-4e94-a36a-a03ddae11eb7 tempest-SnapshotsActionsTest-1355677458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.e500c31f-a10a-46df-9bc0-1aeb83b2b212 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:11 devstack sudo[86864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.e500c31f-a10a-46df-9bc0-1aeb83b2b212
Feb 28 04:43:11 devstack sudo[86864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:11 devstack sudo[86859]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1c2412aa-931f-454d-ab6d-d7bc8a797d95 tempest-GroupSnapshotsV319Test-509011177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6.cf1c2320-a980-498b-baa5-95238e15b24e" returned: 0 in 0.483s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:11 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-1c2412aa-931f-454d-ab6d-d7bc8a797d95 tempest-GroupSnapshotsV319Test-509011177 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:43:11 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efc8cc8-dccb-460a-8227-07922633c1d8]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:43:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1c2412aa-931f-454d-ab6d-d7bc8a797d95 tempest-GroupSnapshotsV319Test-509011177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:11 devstack sudo[86869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6
Feb 28 04:43:11 devstack sudo[86869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:12 devstack sudo[86864]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3e2549ed-8703-4e94-a36a-a03ddae11eb7 tempest-SnapshotsActionsTest-1355677458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.e500c31f-a10a-46df-9bc0-1aeb83b2b212" returned: 0 in 0.512s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:12 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-3e2549ed-8703-4e94-a36a-a03ddae11eb7 tempest-SnapshotsActionsTest-1355677458 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.e500c31f-a10a-46df-9bc0-1aeb83b2b212 is being set with open permissions: ugo+rw
Feb 28 04:43:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3e2549ed-8703-4e94-a36a-a03ddae11eb7 tempest-SnapshotsActionsTest-1355677458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.e500c31f-a10a-46df-9bc0-1aeb83b2b212 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:12 devstack sudo[86874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.e500c31f-a10a-46df-9bc0-1aeb83b2b212
Feb 28 04:43:12 devstack sudo[86874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:12 devstack sudo[86869]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1c2412aa-931f-454d-ab6d-d7bc8a797d95 tempest-GroupSnapshotsV319Test-509011177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6" returned: 0 in 0.517s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1c2412aa-931f-454d-ab6d-d7bc8a797d95 tempest-GroupSnapshotsV319Test-509011177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6.cf1c2320-a980-498b-baa5-95238e15b24e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:12 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-874f787c-214f-42c3-a61c-c8da2bcf8bd3 tempest-GroupSnapshotsTest-1988525138 None] GroupSnapshot 766ef14b-2c27-4a58-a9fd-a25984a80353: creating.
Feb 28 04:43:12 devstack sudo[86879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6.cf1c2320-a980-498b-baa5-95238e15b24e
Feb 28 04:43:12 devstack sudo[86879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-874f787c-214f-42c3-a61c-c8da2bcf8bd3 tempest-GroupSnapshotsTest-1988525138 None] Group snapshot 766ef14b-2c27-4a58-a9fd-a25984a80353: creating. {{(pid=84248) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Feb 28 04:43:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-874f787c-214f-42c3-a61c-c8da2bcf8bd3 tempest-GroupSnapshotsTest-1988525138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:43:12 devstack sudo[86874]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3e2549ed-8703-4e94-a36a-a03ddae11eb7 tempest-SnapshotsActionsTest-1355677458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.e500c31f-a10a-46df-9bc0-1aeb83b2b212" returned: 0 in 0.449s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3e2549ed-8703-4e94-a36a-a03ddae11eb7 tempest-SnapshotsActionsTest-1355677458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.128s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:43:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-879f03a9-5545-49fd-8499-12d625d4529d req-03f3d740-f526-4685-9be6-99447395afeb tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.163s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:43:12 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-3e2549ed-8703-4e94-a36a-a03ddae11eb7 tempest-SnapshotsActionsTest-1355677458 None] Create snapshot completed successfully
Feb 28 04:43:12 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c98aa3-fdd2-483a-8c59-611a84bb206b]: (4, 'raw') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:43:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-879f03a9-5545-49fd-8499-12d625d4529d req-03f3d740-f526-4685-9be6-99447395afeb tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f8e0796a-39b2-4dc1-b3c9-d019f0196d52 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:12 devstack sudo[86882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f8e0796a-39b2-4dc1-b3c9-d019f0196d52
Feb 28 04:43:12 devstack sudo[86882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:12 devstack sudo[86879]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1c2412aa-931f-454d-ab6d-d7bc8a797d95 tempest-GroupSnapshotsV319Test-509011177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6.cf1c2320-a980-498b-baa5-95238e15b24e" returned: 0 in 0.478s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1c2412aa-931f-454d-ab6d-d7bc8a797d95 tempest-GroupSnapshotsV319Test-509011177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6.cf1c2320-a980-498b-baa5-95238e15b24e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:12 devstack sudo[86887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6.cf1c2320-a980-498b-baa5-95238e15b24e
Feb 28 04:43:12 devstack sudo[86887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:13 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-c92e95df-0117-470c-ac29-4465f810c8dc tempest-SnapshotsActionsTest-1818712012 None] Acquiring lock "cinder-e500c31f-a10a-46df-9bc0-1aeb83b2b212-delete_snapshot" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:43:13 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-c92e95df-0117-470c-ac29-4465f810c8dc tempest-SnapshotsActionsTest-1818712012 None] Lock "cinder-e500c31f-a10a-46df-9bc0-1aeb83b2b212-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:43:13 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-c92e95df-0117-470c-ac29-4465f810c8dc tempest-SnapshotsActionsTest-1818712012 None] Acquiring lock "cinder-quobyte-0a27a465-7230-4e68-9540-285c134cf1c5" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:43:13 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-c92e95df-0117-470c-ac29-4465f810c8dc tempest-SnapshotsActionsTest-1818712012 None] Lock "cinder-quobyte-0a27a465-7230-4e68-9540-285c134cf1c5" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:43:13 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-c92e95df-0117-470c-ac29-4465f810c8dc tempest-SnapshotsActionsTest-1818712012 None] Acquiring lock "cinder-quobyte-e500c31f-a10a-46df-9bc0-1aeb83b2b212" by "_delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:43:13 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-c92e95df-0117-470c-ac29-4465f810c8dc tempest-SnapshotsActionsTest-1818712012 None] Lock "cinder-quobyte-e500c31f-a10a-46df-9bc0-1aeb83b2b212" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:43:13 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-c92e95df-0117-470c-ac29-4465f810c8dc tempest-SnapshotsActionsTest-1818712012 None] Deleting offline snapshot e500c31f-a10a-46df-9bc0-1aeb83b2b212 of volume 0a27a465-7230-4e68-9540-285c134cf1c5 {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 04:43:13 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-c92e95df-0117-470c-ac29-4465f810c8dc tempest-SnapshotsActionsTest-1818712012 None] snapshot_file for this snap is: volume-0a27a465-7230-4e68-9540-285c134cf1c5.e500c31f-a10a-46df-9bc0-1aeb83b2b212 {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 04:43:13 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29d25e3-9aa6-433b-a948-c25b8751331f]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:43:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-c92e95df-0117-470c-ac29-4465f810c8dc tempest-SnapshotsActionsTest-1818712012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.e500c31f-a10a-46df-9bc0-1aeb83b2b212 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:13 devstack sudo[86890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.e500c31f-a10a-46df-9bc0-1aeb83b2b212
Feb 28 04:43:13 devstack sudo[86890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:13 devstack sudo[86882]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-879f03a9-5545-49fd-8499-12d625d4529d req-03f3d740-f526-4685-9be6-99447395afeb tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f8e0796a-39b2-4dc1-b3c9-d019f0196d52" returned: 0 in 0.510s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-879f03a9-5545-49fd-8499-12d625d4529d req-03f3d740-f526-4685-9be6-99447395afeb tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f8e0796a-39b2-4dc1-b3c9-d019f0196d52 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:13 devstack sudo[86887]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1c2412aa-931f-454d-ab6d-d7bc8a797d95 tempest-GroupSnapshotsV319Test-509011177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6.cf1c2320-a980-498b-baa5-95238e15b24e" returned: 0 in 0.423s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:13 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1c2412aa-931f-454d-ab6d-d7bc8a797d95 tempest-GroupSnapshotsV319Test-509011177 None] Lock "cinder-quobyte-cf1c2320-a980-498b-baa5-95238e15b24e" released by "_delete_snapshot" :: held 1.963s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:43:13 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1c2412aa-931f-454d-ab6d-d7bc8a797d95 tempest-GroupSnapshotsV319Test-509011177 None] Lock "cinder-quobyte-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6" released by "delete_snapshot" :: held 1.973s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:43:13 devstack sudo[86894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f8e0796a-39b2-4dc1-b3c9-d019f0196d52
Feb 28 04:43:13 devstack sudo[86894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:13 devstack cinder-volume[84248]: WARNING cinder.quota [None req-1c2412aa-931f-454d-ab6d-d7bc8a797d95 tempest-GroupSnapshotsV319Test-509011177 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1639080240 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1639080240, it is now deprecated. Please use the default quota class for default quota.
Feb 28 04:43:13 devstack cinder-volume[84248]: WARNING cinder.quota [None req-1c2412aa-931f-454d-ab6d-d7bc8a797d95 tempest-GroupSnapshotsV319Test-509011177 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1639080240 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1639080240, it is now deprecated. Please use the default quota class for default quota.
Feb 28 04:43:13 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-1c2412aa-931f-454d-ab6d-d7bc8a797d95 tempest-GroupSnapshotsV319Test-509011177 None] Created reservations ['7e37ded7-763d-4d21-af19-b87859477f64', 'b55733f0-bd8d-420c-9651-20601dc34f55', '03dcb80e-4c63-4ef0-b933-b6da96204a3b', '0e25b6d7-70a5-4e8c-a5a5-2d0fe4203797'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:43:13 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-1c2412aa-931f-454d-ab6d-d7bc8a797d95 tempest-GroupSnapshotsV319Test-509011177 None] group_snapshot c57a1c60-64f8-4f3c-bb4a-c1d0630ccdb9: deleted successfully
Feb 28 04:43:13 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-86beeb8a-9d4f-4625-981f-79a3c07c8e62 tempest-GroupSnapshotsV319Test-509011177 None] Acquiring lock "cinder-quobyte-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:43:13 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-86beeb8a-9d4f-4625-981f-79a3c07c8e62 tempest-GroupSnapshotsV319Test-509011177 None] Lock "cinder-quobyte-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6" acquired by "delete_volume" :: waited 0.008s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:43:13 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e4ab56-dfb8-4d81-aa9f-a76b809c932d]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:43:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-86beeb8a-9d4f-4625-981f-79a3c07c8e62 tempest-GroupSnapshotsV319Test-509011177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:13 devstack sudo[86890]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-c92e95df-0117-470c-ac29-4465f810c8dc tempest-SnapshotsActionsTest-1818712012 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.e500c31f-a10a-46df-9bc0-1aeb83b2b212" returned: 0 in 0.573s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:13 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-c92e95df-0117-470c-ac29-4465f810c8dc tempest-SnapshotsActionsTest-1818712012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a27a465-7230-4e68-9540-285c134cf1c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:43:13 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac03f68-7658-4380-96c5-1bb5b4bf6c52]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:43:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-c92e95df-0117-470c-ac29-4465f810c8dc tempest-SnapshotsActionsTest-1818712012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:13 devstack sudo[86899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6
Feb 28 04:43:13 devstack sudo[86899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:13 devstack sudo[86894]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-879f03a9-5545-49fd-8499-12d625d4529d req-03f3d740-f526-4685-9be6-99447395afeb tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f8e0796a-39b2-4dc1-b3c9-d019f0196d52" returned: 1 in 0.537s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-879f03a9-5545-49fd-8499-12d625d4529d req-03f3d740-f526-4685-9be6-99447395afeb tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f8e0796a-39b2-4dc1-b3c9-d019f0196d52' failed. Not Retrying. {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 28 04:43:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-879f03a9-5545-49fd-8499-12d625d4529d req-03f3d740-f526-4685-9be6-99447395afeb tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.082s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:43:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-874f787c-214f-42c3-a61c-c8da2bcf8bd3 tempest-GroupSnapshotsTest-1988525138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.358s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:43:13 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-874f787c-214f-42c3-a61c-c8da2bcf8bd3 tempest-GroupSnapshotsTest-1988525138 None] Creating offline snapshot a6bb3d3b-9ef8-40da-8eee-5bfb01a25d6f of volume a7913619-1daf-46ed-85c1-1703d6a97298 {{(pid=84248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 04:43:13 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[7508bc40-b782-4601-8faa-b42928344d06]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:43:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-874f787c-214f-42c3-a61c-c8da2bcf8bd3 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:13 devstack sudo[86903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc
Feb 28 04:43:13 devstack sudo[86903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:13 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-879f03a9-5545-49fd-8499-12d625d4529d req-03f3d740-f526-4685-9be6-99447395afeb tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035', 'name': 'volume-f8e0796a-39b2-4dc1-b3c9-d019f0196d52', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '98c87d3a-04cc-418d-9759-6467d53b7727', 'enforce_multipath': True} {{(pid=84248) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Feb 28 04:43:13 devstack cinder-volume[84248]: INFO cinder.volume.manager [req-879f03a9-5545-49fd-8499-12d625d4529d req-03f3d740-f526-4685-9be6-99447395afeb tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] attachment_update completed successfully.
Feb 28 04:43:13 devstack sudo[86905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298
Feb 28 04:43:13 devstack sudo[86905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:14 devstack sudo[86899]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-86beeb8a-9d4f-4625-981f-79a3c07c8e62 tempest-GroupSnapshotsV319Test-509011177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6" returned: 0 in 0.487s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-86beeb8a-9d4f-4625-981f-79a3c07c8e62 tempest-GroupSnapshotsV319Test-509011177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:14 devstack sudo[86913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6
Feb 28 04:43:14 devstack sudo[86913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:14 devstack sudo[86903]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-c92e95df-0117-470c-ac29-4465f810c8dc tempest-SnapshotsActionsTest-1818712012 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc" returned: 0 in 0.522s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:14 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-c92e95df-0117-470c-ac29-4465f810c8dc tempest-SnapshotsActionsTest-1818712012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a27a465-7230-4e68-9540-285c134cf1c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:43:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-c92e95df-0117-470c-ac29-4465f810c8dc tempest-SnapshotsActionsTest-1818712012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.e500c31f-a10a-46df-9bc0-1aeb83b2b212 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:14 devstack sudo[86919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.e500c31f-a10a-46df-9bc0-1aeb83b2b212
Feb 28 04:43:14 devstack sudo[86919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:14 devstack sudo[86905]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-874f787c-214f-42c3-a61c-c8da2bcf8bd3 tempest-GroupSnapshotsTest-1988525138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298" returned: 0 in 0.501s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-874f787c-214f-42c3-a61c-c8da2bcf8bd3 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298.a6bb3d3b-9ef8-40da-8eee-5bfb01a25d6f 1G {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:14 devstack sudo[86921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298.a6bb3d3b-9ef8-40da-8eee-5bfb01a25d6f 1G
Feb 28 04:43:14 devstack sudo[86921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:14 devstack sudo[86913]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-86beeb8a-9d4f-4625-981f-79a3c07c8e62 tempest-GroupSnapshotsV319Test-509011177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6" returned: 0 in 0.442s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:14 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-86beeb8a-9d4f-4625-981f-79a3c07c8e62 tempest-GroupSnapshotsV319Test-509011177 None] Lock "cinder-quobyte-6f8d08bf-75ec-46c6-b61f-e66b7b1c2ff6" released by "delete_volume" :: held 0.974s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:43:14 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-86beeb8a-9d4f-4625-981f-79a3c07c8e62 tempest-GroupSnapshotsV319Test-509011177 None] Created reservations ['ea71704e-bd6c-46f9-a3a1-50b98ae38b48'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:43:14 devstack cinder-volume[84248]: WARNING cinder.quota [None req-86beeb8a-9d4f-4625-981f-79a3c07c8e62 tempest-GroupSnapshotsV319Test-509011177 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1639080240 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1639080240, it is now deprecated. Please use the default quota class for default quota.
Feb 28 04:43:14 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-86beeb8a-9d4f-4625-981f-79a3c07c8e62 tempest-GroupSnapshotsV319Test-509011177 None] Created reservations ['dbaf091b-5dd0-4c5d-b505-6c798309f1cd', 'adceaeb9-2ba2-4209-87e3-fd034b1d68ff', '8c9a7b83-1848-40c1-8892-3441a467399d', 'bfe07c5d-30bd-4406-962b-cf6c2a7c422a'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:43:14 devstack sudo[86919]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-86beeb8a-9d4f-4625-981f-79a3c07c8e62 tempest-GroupSnapshotsV319Test-509011177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:43:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-86beeb8a-9d4f-4625-981f-79a3c07c8e62 tempest-GroupSnapshotsV319Test-509011177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:43:14 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-86beeb8a-9d4f-4625-981f-79a3c07c8e62 tempest-GroupSnapshotsV319Test-509011177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:43:14 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-86beeb8a-9d4f-4625-981f-79a3c07c8e62 tempest-GroupSnapshotsV319Test-509011177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:43:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-86beeb8a-9d4f-4625-981f-79a3c07c8e62 tempest-GroupSnapshotsV319Test-509011177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:43:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-86beeb8a-9d4f-4625-981f-79a3c07c8e62 tempest-GroupSnapshotsV319Test-509011177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-c92e95df-0117-470c-ac29-4465f810c8dc tempest-SnapshotsActionsTest-1818712012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.e500c31f-a10a-46df-9bc0-1aeb83b2b212" returned: 0 in 0.588s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-c92e95df-0117-470c-ac29-4465f810c8dc tempest-SnapshotsActionsTest-1818712012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.e500c31f-a10a-46df-9bc0-1aeb83b2b212 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:14 devstack sudo[86930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:43:14 devstack sudo[86930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:14 devstack sudo[86921]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-874f787c-214f-42c3-a61c-c8da2bcf8bd3 tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298.a6bb3d3b-9ef8-40da-8eee-5bfb01a25d6f 1G" returned: 0 in 0.545s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-874f787c-214f-42c3-a61c-c8da2bcf8bd3 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7913619-1daf-46ed-85c1-1703d6a97298 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298.a6bb3d3b-9ef8-40da-8eee-5bfb01a25d6f {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:14 devstack sudo[86931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.e500c31f-a10a-46df-9bc0-1aeb83b2b212
Feb 28 04:43:14 devstack sudo[86931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:14 devstack sudo[86933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7913619-1daf-46ed-85c1-1703d6a97298 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298.a6bb3d3b-9ef8-40da-8eee-5bfb01a25d6f
Feb 28 04:43:14 devstack sudo[86933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:15 devstack sudo[86931]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-c92e95df-0117-470c-ac29-4465f810c8dc tempest-SnapshotsActionsTest-1818712012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.e500c31f-a10a-46df-9bc0-1aeb83b2b212" returned: 0 in 0.407s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:15 devstack sudo[86930]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:15 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-c92e95df-0117-470c-ac29-4465f810c8dc tempest-SnapshotsActionsTest-1818712012 None] Lock "cinder-quobyte-e500c31f-a10a-46df-9bc0-1aeb83b2b212" released by "_delete_snapshot" :: held 2.137s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:43:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-86beeb8a-9d4f-4625-981f-79a3c07c8e62 tempest-GroupSnapshotsV319Test-509011177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.437s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:15 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-86beeb8a-9d4f-4625-981f-79a3c07c8e62 tempest-GroupSnapshotsV319Test-509011177 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:43:15 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-c92e95df-0117-470c-ac29-4465f810c8dc tempest-SnapshotsActionsTest-1818712012 None] Lock "cinder-quobyte-0a27a465-7230-4e68-9540-285c134cf1c5" released by "delete_snapshot" :: held 2.159s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:43:15 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-86beeb8a-9d4f-4625-981f-79a3c07c8e62 tempest-GroupSnapshotsV319Test-509011177 None] Delete group completed successfully.
Feb 28 04:43:15 devstack sudo[86933]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-874f787c-214f-42c3-a61c-c8da2bcf8bd3 tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7913619-1daf-46ed-85c1-1703d6a97298 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298.a6bb3d3b-9ef8-40da-8eee-5bfb01a25d6f" returned: 0 in 0.450s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:15 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-874f787c-214f-42c3-a61c-c8da2bcf8bd3 tempest-GroupSnapshotsTest-1988525138 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298.a6bb3d3b-9ef8-40da-8eee-5bfb01a25d6f is being set with open permissions: ugo+rw: NotImplementedError
Feb 28 04:43:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-874f787c-214f-42c3-a61c-c8da2bcf8bd3 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298.a6bb3d3b-9ef8-40da-8eee-5bfb01a25d6f {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:15 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-c92e95df-0117-470c-ac29-4465f810c8dc tempest-SnapshotsActionsTest-1818712012 None] Created reservations ['3c597c09-f108-43c6-8130-08e6e750fb06', '3b532aba-fb54-4ab2-b317-d2fc0d1796ae', '56db8f28-ba3e-4cb4-af32-e2644c47384f', 'd6b45ff4-3b31-4954-91ce-66f35f07e939'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:43:15 devstack sudo[86941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298.a6bb3d3b-9ef8-40da-8eee-5bfb01a25d6f
Feb 28 04:43:15 devstack sudo[86941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:15 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-c92e95df-0117-470c-ac29-4465f810c8dc tempest-SnapshotsActionsTest-1818712012 None] Delete snapshot completed successfully.
Feb 28 04:43:15 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-c92e95df-0117-470c-ac29-4465f810c8dc tempest-SnapshotsActionsTest-1818712012 None] Lock "cinder-e500c31f-a10a-46df-9bc0-1aeb83b2b212-delete_snapshot" released by "delete_snapshot" :: held 2.268s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:43:15 devstack sudo[86941]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-874f787c-214f-42c3-a61c-c8da2bcf8bd3 tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298.a6bb3d3b-9ef8-40da-8eee-5bfb01a25d6f" returned: 0 in 0.459s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-874f787c-214f-42c3-a61c-c8da2bcf8bd3 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:15 devstack sudo[86944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298.info
Feb 28 04:43:15 devstack sudo[86944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:16 devstack sudo[86944]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-874f787c-214f-42c3-a61c-c8da2bcf8bd3 tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298.info" returned: 0 in 0.612s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:16 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-874f787c-214f-42c3-a61c-c8da2bcf8bd3 tempest-GroupSnapshotsTest-1988525138 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298.info is being set with open permissions: ugo+rw: NotImplementedError
Feb 28 04:43:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-874f787c-214f-42c3-a61c-c8da2bcf8bd3 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:16 devstack sudo[86981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298.info
Feb 28 04:43:16 devstack sudo[86981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-82a2f086-9373-4457-a95b-7e38e9bb870d tempest-SnapshotsActionsTest-1355677458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:43:16 devstack sudo[86981]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-874f787c-214f-42c3-a61c-c8da2bcf8bd3 tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298.info" returned: 0 in 0.469s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-874f787c-214f-42c3-a61c-c8da2bcf8bd3 tempest-GroupSnapshotsTest-1988525138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.090s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:43:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-874f787c-214f-42c3-a61c-c8da2bcf8bd3 tempest-GroupSnapshotsTest-1988525138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:43:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-874f787c-214f-42c3-a61c-c8da2bcf8bd3 tempest-GroupSnapshotsTest-1988525138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:43:16 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-874f787c-214f-42c3-a61c-c8da2bcf8bd3 tempest-GroupSnapshotsTest-1988525138 None] Creating offline snapshot ace032fd-491a-4071-91e4-92e9ff15edef of volume 2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27 {{(pid=84248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 04:43:16 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58a4f1b-a499-481f-ba6d-b72ee8cac8e1]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:43:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-874f787c-214f-42c3-a61c-c8da2bcf8bd3 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:17 devstack sudo[86987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27
Feb 28 04:43:17 devstack sudo[86987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:17 devstack sudo[86987]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-874f787c-214f-42c3-a61c-c8da2bcf8bd3 tempest-GroupSnapshotsTest-1988525138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27" returned: 0 in 0.587s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-874f787c-214f-42c3-a61c-c8da2bcf8bd3 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27.ace032fd-491a-4071-91e4-92e9ff15edef 1G {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:17 devstack sudo[86992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27.ace032fd-491a-4071-91e4-92e9ff15edef 1G
Feb 28 04:43:17 devstack sudo[86992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:18 devstack sudo[86992]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-874f787c-214f-42c3-a61c-c8da2bcf8bd3 tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27.ace032fd-491a-4071-91e4-92e9ff15edef 1G" returned: 0 in 0.528s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-874f787c-214f-42c3-a61c-c8da2bcf8bd3 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27.ace032fd-491a-4071-91e4-92e9ff15edef {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:18 devstack sudo[86997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27.ace032fd-491a-4071-91e4-92e9ff15edef
Feb 28 04:43:18 devstack sudo[86997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:18 devstack sudo[86997]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-874f787c-214f-42c3-a61c-c8da2bcf8bd3 tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27.ace032fd-491a-4071-91e4-92e9ff15edef" returned: 0 in 0.675s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:18 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-874f787c-214f-42c3-a61c-c8da2bcf8bd3 tempest-GroupSnapshotsTest-1988525138 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27.ace032fd-491a-4071-91e4-92e9ff15edef is being set with open permissions: ugo+rw: NotImplementedError
Feb 28 04:43:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-874f787c-214f-42c3-a61c-c8da2bcf8bd3 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27.ace032fd-491a-4071-91e4-92e9ff15edef {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:18 devstack sudo[87026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27.ace032fd-491a-4071-91e4-92e9ff15edef
Feb 28 04:43:18 devstack sudo[87026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:19 devstack sudo[87026]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-874f787c-214f-42c3-a61c-c8da2bcf8bd3 tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27.ace032fd-491a-4071-91e4-92e9ff15edef" returned: 0 in 0.625s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-874f787c-214f-42c3-a61c-c8da2bcf8bd3 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:19 devstack sudo[87036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27.info
Feb 28 04:43:19 devstack sudo[87036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:19 devstack sudo[87036]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-874f787c-214f-42c3-a61c-c8da2bcf8bd3 tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27.info" returned: 0 in 0.483s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:19 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-874f787c-214f-42c3-a61c-c8da2bcf8bd3 tempest-GroupSnapshotsTest-1988525138 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27.info is being set with open permissions: ugo+rw: NotImplementedError
Feb 28 04:43:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-874f787c-214f-42c3-a61c-c8da2bcf8bd3 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:19 devstack sudo[87040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27.info
Feb 28 04:43:19 devstack sudo[87040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:20 devstack sudo[87040]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-874f787c-214f-42c3-a61c-c8da2bcf8bd3 tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27.info" returned: 0 in 0.563s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-874f787c-214f-42c3-a61c-c8da2bcf8bd3 tempest-GroupSnapshotsTest-1988525138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.523s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:43:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-82a2f086-9373-4457-a95b-7e38e9bb870d tempest-SnapshotsActionsTest-1355677458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.823s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:43:20 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-82a2f086-9373-4457-a95b-7e38e9bb870d tempest-SnapshotsActionsTest-1355677458 None] Creating offline snapshot a3374d5c-9736-4052-aa76-0a4c24b8ce91 of volume 0a27a465-7230-4e68-9540-285c134cf1c5 {{(pid=84248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 04:43:20 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cce272a-2677-43d8-925e-60b62a62ec2c]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:43:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-82a2f086-9373-4457-a95b-7e38e9bb870d tempest-SnapshotsActionsTest-1355677458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:20 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-874f787c-214f-42c3-a61c-c8da2bcf8bd3 tempest-GroupSnapshotsTest-1988525138 None] group_snapshot 766ef14b-2c27-4a58-a9fd-a25984a80353: created successfully
Feb 28 04:43:20 devstack sudo[87043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc
Feb 28 04:43:20 devstack sudo[87043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:20 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-ac330738-4871-4c3f-9867-37020d1149a8 tempest-GroupSnapshotsTest-1988525138 None] group_snapshot 766ef14b-2c27-4a58-a9fd-a25984a80353: deleting
Feb 28 04:43:20 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ac330738-4871-4c3f-9867-37020d1149a8 tempest-GroupSnapshotsTest-1988525138 None] group_snapshot 766ef14b-2c27-4a58-a9fd-a25984a80353: deleting {{(pid=84248) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Feb 28 04:43:20 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ac330738-4871-4c3f-9867-37020d1149a8 tempest-GroupSnapshotsTest-1988525138 None] Acquiring lock "cinder-quobyte-a7913619-1daf-46ed-85c1-1703d6a97298" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:43:20 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ac330738-4871-4c3f-9867-37020d1149a8 tempest-GroupSnapshotsTest-1988525138 None] Lock "cinder-quobyte-a7913619-1daf-46ed-85c1-1703d6a97298" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:43:20 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ac330738-4871-4c3f-9867-37020d1149a8 tempest-GroupSnapshotsTest-1988525138 None] Acquiring lock "cinder-quobyte-a6bb3d3b-9ef8-40da-8eee-5bfb01a25d6f" by "_delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:43:20 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ac330738-4871-4c3f-9867-37020d1149a8 tempest-GroupSnapshotsTest-1988525138 None] Lock "cinder-quobyte-a6bb3d3b-9ef8-40da-8eee-5bfb01a25d6f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:43:20 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-ac330738-4871-4c3f-9867-37020d1149a8 tempest-GroupSnapshotsTest-1988525138 None] Deleting offline snapshot a6bb3d3b-9ef8-40da-8eee-5bfb01a25d6f of volume a7913619-1daf-46ed-85c1-1703d6a97298 {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 04:43:20 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-ac330738-4871-4c3f-9867-37020d1149a8 tempest-GroupSnapshotsTest-1988525138 None] snapshot_file for this snap is: volume-a7913619-1daf-46ed-85c1-1703d6a97298.a6bb3d3b-9ef8-40da-8eee-5bfb01a25d6f {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 04:43:21 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[186c4171-aee7-4195-b712-08f2af51d179]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:43:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ac330738-4871-4c3f-9867-37020d1149a8 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298.a6bb3d3b-9ef8-40da-8eee-5bfb01a25d6f {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:21 devstack sudo[87045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298.a6bb3d3b-9ef8-40da-8eee-5bfb01a25d6f
Feb 28 04:43:21 devstack sudo[87045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:21 devstack sudo[87043]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-82a2f086-9373-4457-a95b-7e38e9bb870d tempest-SnapshotsActionsTest-1355677458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc" returned: 0 in 0.795s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:21 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-82a2f086-9373-4457-a95b-7e38e9bb870d tempest-SnapshotsActionsTest-1355677458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a27a465-7230-4e68-9540-285c134cf1c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:43:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-82a2f086-9373-4457-a95b-7e38e9bb870d tempest-SnapshotsActionsTest-1355677458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.a3374d5c-9736-4052-aa76-0a4c24b8ce91 1G {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:21 devstack sudo[87050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.a3374d5c-9736-4052-aa76-0a4c24b8ce91 1G
Feb 28 04:43:21 devstack sudo[87050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:21 devstack sudo[87045]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ac330738-4871-4c3f-9867-37020d1149a8 tempest-GroupSnapshotsTest-1988525138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298.a6bb3d3b-9ef8-40da-8eee-5bfb01a25d6f" returned: 0 in 0.928s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:21 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-ac330738-4871-4c3f-9867-37020d1149a8 tempest-GroupSnapshotsTest-1988525138 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7913619-1daf-46ed-85c1-1703d6a97298(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:43:21 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46f6a6a-b728-4aef-8536-72800cc8992e]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:43:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ac330738-4871-4c3f-9867-37020d1149a8 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:22 devstack sudo[87050]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-82a2f086-9373-4457-a95b-7e38e9bb870d tempest-SnapshotsActionsTest-1355677458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.a3374d5c-9736-4052-aa76-0a4c24b8ce91 1G" returned: 0 in 0.757s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-82a2f086-9373-4457-a95b-7e38e9bb870d tempest-SnapshotsActionsTest-1355677458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.a3374d5c-9736-4052-aa76-0a4c24b8ce91 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:22 devstack sudo[87059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.a3374d5c-9736-4052-aa76-0a4c24b8ce91
Feb 28 04:43:22 devstack sudo[87059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:22 devstack sudo[87058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298
Feb 28 04:43:22 devstack sudo[87058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:22 devstack sudo[87059]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-82a2f086-9373-4457-a95b-7e38e9bb870d tempest-SnapshotsActionsTest-1355677458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.a3374d5c-9736-4052-aa76-0a4c24b8ce91" returned: 0 in 0.651s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:22 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-82a2f086-9373-4457-a95b-7e38e9bb870d tempest-SnapshotsActionsTest-1355677458 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.a3374d5c-9736-4052-aa76-0a4c24b8ce91 is being set with open permissions: ugo+rw
Feb 28 04:43:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-82a2f086-9373-4457-a95b-7e38e9bb870d tempest-SnapshotsActionsTest-1355677458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.a3374d5c-9736-4052-aa76-0a4c24b8ce91 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:22 devstack sudo[87068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.a3374d5c-9736-4052-aa76-0a4c24b8ce91
Feb 28 04:43:22 devstack sudo[87068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:22 devstack sudo[87058]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ac330738-4871-4c3f-9867-37020d1149a8 tempest-GroupSnapshotsTest-1988525138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298" returned: 0 in 0.943s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ac330738-4871-4c3f-9867-37020d1149a8 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298.a6bb3d3b-9ef8-40da-8eee-5bfb01a25d6f {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:22 devstack sudo[87070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298.a6bb3d3b-9ef8-40da-8eee-5bfb01a25d6f
Feb 28 04:43:22 devstack sudo[87070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:23 devstack sudo[87068]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-82a2f086-9373-4457-a95b-7e38e9bb870d tempest-SnapshotsActionsTest-1355677458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.a3374d5c-9736-4052-aa76-0a4c24b8ce91" returned: 0 in 0.527s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-82a2f086-9373-4457-a95b-7e38e9bb870d tempest-SnapshotsActionsTest-1355677458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.867s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:43:23 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-82a2f086-9373-4457-a95b-7e38e9bb870d tempest-SnapshotsActionsTest-1355677458 None] Create snapshot completed successfully
Feb 28 04:43:23 devstack sudo[87070]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ac330738-4871-4c3f-9867-37020d1149a8 tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298.a6bb3d3b-9ef8-40da-8eee-5bfb01a25d6f" returned: 0 in 0.570s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ac330738-4871-4c3f-9867-37020d1149a8 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298.a6bb3d3b-9ef8-40da-8eee-5bfb01a25d6f {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:23 devstack sudo[87076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298.a6bb3d3b-9ef8-40da-8eee-5bfb01a25d6f
Feb 28 04:43:23 devstack sudo[87076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:23 devstack sudo[87076]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ac330738-4871-4c3f-9867-37020d1149a8 tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298.a6bb3d3b-9ef8-40da-8eee-5bfb01a25d6f" returned: 0 in 0.522s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:24 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ac330738-4871-4c3f-9867-37020d1149a8 tempest-GroupSnapshotsTest-1988525138 None] Lock "cinder-quobyte-a6bb3d3b-9ef8-40da-8eee-5bfb01a25d6f" released by "_delete_snapshot" :: held 3.089s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:43:24 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ac330738-4871-4c3f-9867-37020d1149a8 tempest-GroupSnapshotsTest-1988525138 None] Lock "cinder-quobyte-a7913619-1daf-46ed-85c1-1703d6a97298" released by "delete_snapshot" :: held 3.112s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:43:24 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ac330738-4871-4c3f-9867-37020d1149a8 tempest-GroupSnapshotsTest-1988525138 None] Acquiring lock "cinder-quobyte-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:43:24 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ac330738-4871-4c3f-9867-37020d1149a8 tempest-GroupSnapshotsTest-1988525138 None] Lock "cinder-quobyte-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27" acquired by "delete_snapshot" :: waited 0.009s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:43:24 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ac330738-4871-4c3f-9867-37020d1149a8 tempest-GroupSnapshotsTest-1988525138 None] Acquiring lock "cinder-quobyte-ace032fd-491a-4071-91e4-92e9ff15edef" by "_delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:43:24 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ac330738-4871-4c3f-9867-37020d1149a8 tempest-GroupSnapshotsTest-1988525138 None] Lock "cinder-quobyte-ace032fd-491a-4071-91e4-92e9ff15edef" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:43:24 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-ac330738-4871-4c3f-9867-37020d1149a8 tempest-GroupSnapshotsTest-1988525138 None] Deleting offline snapshot ace032fd-491a-4071-91e4-92e9ff15edef of volume 2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27 {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 04:43:24 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-ac330738-4871-4c3f-9867-37020d1149a8 tempest-GroupSnapshotsTest-1988525138 None] snapshot_file for this snap is: volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27.ace032fd-491a-4071-91e4-92e9ff15edef {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 04:43:24 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[d455f9f3-1090-4a06-bc34-c8f790fe9e2e]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:43:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ac330738-4871-4c3f-9867-37020d1149a8 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27.ace032fd-491a-4071-91e4-92e9ff15edef {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:24 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8a4c2042-2920-4b90-9b84-459f80cd3f43 tempest-SnapshotsActionsTest-1818712012 None] Acquiring lock "cinder-a3374d5c-9736-4052-aa76-0a4c24b8ce91-delete_snapshot" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:43:24 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8a4c2042-2920-4b90-9b84-459f80cd3f43 tempest-SnapshotsActionsTest-1818712012 None] Lock "cinder-a3374d5c-9736-4052-aa76-0a4c24b8ce91-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:43:24 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8a4c2042-2920-4b90-9b84-459f80cd3f43 tempest-SnapshotsActionsTest-1818712012 None] Acquiring lock "cinder-quobyte-0a27a465-7230-4e68-9540-285c134cf1c5" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:43:24 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8a4c2042-2920-4b90-9b84-459f80cd3f43 tempest-SnapshotsActionsTest-1818712012 None] Lock "cinder-quobyte-0a27a465-7230-4e68-9540-285c134cf1c5" acquired by "delete_snapshot" :: waited 0.006s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:43:24 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8a4c2042-2920-4b90-9b84-459f80cd3f43 tempest-SnapshotsActionsTest-1818712012 None] Acquiring lock "cinder-quobyte-a3374d5c-9736-4052-aa76-0a4c24b8ce91" by "_delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:43:24 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8a4c2042-2920-4b90-9b84-459f80cd3f43 tempest-SnapshotsActionsTest-1818712012 None] Lock "cinder-quobyte-a3374d5c-9736-4052-aa76-0a4c24b8ce91" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:43:24 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-8a4c2042-2920-4b90-9b84-459f80cd3f43 tempest-SnapshotsActionsTest-1818712012 None] Deleting offline snapshot a3374d5c-9736-4052-aa76-0a4c24b8ce91 of volume 0a27a465-7230-4e68-9540-285c134cf1c5 {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 04:43:24 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-8a4c2042-2920-4b90-9b84-459f80cd3f43 tempest-SnapshotsActionsTest-1818712012 None] snapshot_file for this snap is: volume-0a27a465-7230-4e68-9540-285c134cf1c5.a3374d5c-9736-4052-aa76-0a4c24b8ce91 {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 04:43:24 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[b296b87e-84cb-4c29-869e-016b591cdc1e]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:43:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8a4c2042-2920-4b90-9b84-459f80cd3f43 tempest-SnapshotsActionsTest-1818712012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.a3374d5c-9736-4052-aa76-0a4c24b8ce91 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:24 devstack sudo[87079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27.ace032fd-491a-4071-91e4-92e9ff15edef
Feb 28 04:43:24 devstack sudo[87079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:24 devstack sudo[87080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.a3374d5c-9736-4052-aa76-0a4c24b8ce91
Feb 28 04:43:24 devstack sudo[87080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:24 devstack cinder-volume[84248]: DEBUG oslo_service.periodic_task [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84248) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 28 04:43:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:43:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:43:24 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:43:24 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:43:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:43:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:24 devstack sudo[87086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:43:24 devstack sudo[87086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:24 devstack sudo[87079]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ac330738-4871-4c3f-9867-37020d1149a8 tempest-GroupSnapshotsTest-1988525138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27.ace032fd-491a-4071-91e4-92e9ff15edef" returned: 0 in 0.541s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:24 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-ac330738-4871-4c3f-9867-37020d1149a8 tempest-GroupSnapshotsTest-1988525138 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:43:24 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[828d082a-02dd-44a2-a931-3faea38233ff]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:43:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ac330738-4871-4c3f-9867-37020d1149a8 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:24 devstack sudo[87080]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8a4c2042-2920-4b90-9b84-459f80cd3f43 tempest-SnapshotsActionsTest-1818712012 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.a3374d5c-9736-4052-aa76-0a4c24b8ce91" returned: 0 in 0.519s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:24 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-8a4c2042-2920-4b90-9b84-459f80cd3f43 tempest-SnapshotsActionsTest-1818712012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a27a465-7230-4e68-9540-285c134cf1c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:43:24 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3ef3be-af0c-4f43-94cc-044ee57b32f8]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:43:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8a4c2042-2920-4b90-9b84-459f80cd3f43 tempest-SnapshotsActionsTest-1818712012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:24 devstack sudo[87091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27
Feb 28 04:43:24 devstack sudo[87091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:24 devstack sudo[87092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc
Feb 28 04:43:24 devstack sudo[87092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:24 devstack sudo[87086]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.407s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:24 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:43:25 devstack sudo[87091]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ac330738-4871-4c3f-9867-37020d1149a8 tempest-GroupSnapshotsTest-1988525138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27" returned: 0 in 0.524s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ac330738-4871-4c3f-9867-37020d1149a8 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27.ace032fd-491a-4071-91e4-92e9ff15edef {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:25 devstack sudo[87101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27.ace032fd-491a-4071-91e4-92e9ff15edef
Feb 28 04:43:25 devstack sudo[87101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:25 devstack sudo[87092]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8a4c2042-2920-4b90-9b84-459f80cd3f43 tempest-SnapshotsActionsTest-1818712012 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc" returned: 0 in 0.569s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:25 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-8a4c2042-2920-4b90-9b84-459f80cd3f43 tempest-SnapshotsActionsTest-1818712012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a27a465-7230-4e68-9540-285c134cf1c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:43:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8a4c2042-2920-4b90-9b84-459f80cd3f43 tempest-SnapshotsActionsTest-1818712012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.a3374d5c-9736-4052-aa76-0a4c24b8ce91 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:25 devstack sudo[87104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.a3374d5c-9736-4052-aa76-0a4c24b8ce91
Feb 28 04:43:25 devstack sudo[87104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:25 devstack sudo[87101]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ac330738-4871-4c3f-9867-37020d1149a8 tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27.ace032fd-491a-4071-91e4-92e9ff15edef" returned: 0 in 0.668s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ac330738-4871-4c3f-9867-37020d1149a8 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27.ace032fd-491a-4071-91e4-92e9ff15edef {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:25 devstack sudo[87112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27.ace032fd-491a-4071-91e4-92e9ff15edef
Feb 28 04:43:25 devstack sudo[87112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:25 devstack sudo[87104]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8a4c2042-2920-4b90-9b84-459f80cd3f43 tempest-SnapshotsActionsTest-1818712012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.a3374d5c-9736-4052-aa76-0a4c24b8ce91" returned: 0 in 0.584s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8a4c2042-2920-4b90-9b84-459f80cd3f43 tempest-SnapshotsActionsTest-1818712012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.a3374d5c-9736-4052-aa76-0a4c24b8ce91 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:25 devstack sudo[87114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.a3374d5c-9736-4052-aa76-0a4c24b8ce91
Feb 28 04:43:25 devstack sudo[87114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:26 devstack sudo[87112]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ac330738-4871-4c3f-9867-37020d1149a8 tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27.ace032fd-491a-4071-91e4-92e9ff15edef" returned: 0 in 0.510s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:26 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ac330738-4871-4c3f-9867-37020d1149a8 tempest-GroupSnapshotsTest-1988525138 None] Lock "cinder-quobyte-ace032fd-491a-4071-91e4-92e9ff15edef" released by "_delete_snapshot" :: held 2.293s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:43:26 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ac330738-4871-4c3f-9867-37020d1149a8 tempest-GroupSnapshotsTest-1988525138 None] Lock "cinder-quobyte-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27" released by "delete_snapshot" :: held 2.306s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:43:26 devstack sudo[87114]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8a4c2042-2920-4b90-9b84-459f80cd3f43 tempest-SnapshotsActionsTest-1818712012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.a3374d5c-9736-4052-aa76-0a4c24b8ce91" returned: 0 in 0.524s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:26 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8a4c2042-2920-4b90-9b84-459f80cd3f43 tempest-SnapshotsActionsTest-1818712012 None] Lock "cinder-quobyte-a3374d5c-9736-4052-aa76-0a4c24b8ce91" released by "_delete_snapshot" :: held 2.261s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:43:26 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8a4c2042-2920-4b90-9b84-459f80cd3f43 tempest-SnapshotsActionsTest-1818712012 None] Lock "cinder-quobyte-0a27a465-7230-4e68-9540-285c134cf1c5" released by "delete_snapshot" :: held 2.292s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:43:26 devstack cinder-volume[84248]: WARNING cinder.quota [None req-ac330738-4871-4c3f-9867-37020d1149a8 tempest-GroupSnapshotsTest-1988525138 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1202035307 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1202035307, it is now deprecated. Please use the default quota class for default quota.
Feb 28 04:43:26 devstack cinder-volume[84248]: WARNING cinder.quota [None req-ac330738-4871-4c3f-9867-37020d1149a8 tempest-GroupSnapshotsTest-1988525138 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1202035307 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1202035307, it is now deprecated. Please use the default quota class for default quota.
Feb 28 04:43:26 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-8a4c2042-2920-4b90-9b84-459f80cd3f43 tempest-SnapshotsActionsTest-1818712012 None] Created reservations ['683cab6f-1185-4f19-9190-2d5b8bc4a6c2', '175d67dc-3d8e-4fd6-a775-a8199de3681c', '9722cf8a-e762-4336-920a-30dea8548e8d', '6ec6150a-4b0e-424f-bf21-a58c133412c9'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:43:26 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-ac330738-4871-4c3f-9867-37020d1149a8 tempest-GroupSnapshotsTest-1988525138 None] Created reservations ['0849aba9-7b1f-4a07-8679-1c536d002d48', '23cff019-958b-4f0d-83d3-ae454ed847a4', '3482c201-3d5d-4721-8534-8d63ad351439', 'b32225e5-ac0c-4dc4-ac04-62389e9b8786'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:43:26 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-8a4c2042-2920-4b90-9b84-459f80cd3f43 tempest-SnapshotsActionsTest-1818712012 None] Delete snapshot completed successfully.
Feb 28 04:43:26 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8a4c2042-2920-4b90-9b84-459f80cd3f43 tempest-SnapshotsActionsTest-1818712012 None] Lock "cinder-a3374d5c-9736-4052-aa76-0a4c24b8ce91-delete_snapshot" released by "delete_snapshot" :: held 2.426s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:43:26 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-ac330738-4871-4c3f-9867-37020d1149a8 tempest-GroupSnapshotsTest-1988525138 None] Created reservations ['a9004b5f-d2af-4454-9b06-97ff4bd511fe', '8ae90af6-df62-43c9-b28f-972a199f0f53', '808865c6-487d-4f9c-a5e9-0797c8b07c5f', 'b7dee77a-0749-4f46-8688-ac28cfcd6432'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:43:26 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-ac330738-4871-4c3f-9867-37020d1149a8 tempest-GroupSnapshotsTest-1988525138 None] group_snapshot 766ef14b-2c27-4a58-a9fd-a25984a80353: deleted successfully
Feb 28 04:43:27 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e3a9c84d-6667-4045-a3e0-126cbb7c7299 tempest-SnapshotsActionsTest-1355677458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:43:27 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e3a9c84d-6667-4045-a3e0-126cbb7c7299 tempest-SnapshotsActionsTest-1355677458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:43:27 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-e3a9c84d-6667-4045-a3e0-126cbb7c7299 tempest-SnapshotsActionsTest-1355677458 None] Creating offline snapshot d9a2a56c-cfd9-48b7-9141-9fdedc95d43d of volume 0a27a465-7230-4e68-9540-285c134cf1c5 {{(pid=84248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 04:43:27 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[6575a200-c6d5-4dd2-b425-54bd79f49024]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:43:27 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e3a9c84d-6667-4045-a3e0-126cbb7c7299 tempest-SnapshotsActionsTest-1355677458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:27 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-185fe9da-9af6-46cc-aa71-099a63f112ac tempest-GroupSnapshotsTest-1988525138 None] Acquiring lock "cinder-quobyte-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:43:27 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-185fe9da-9af6-46cc-aa71-099a63f112ac tempest-GroupSnapshotsTest-1988525138 None] Lock "cinder-quobyte-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27" acquired by "delete_volume" :: waited 0.014s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:43:27 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd71aba7-1c17-4715-8d54-257703e60da5]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:43:27 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-185fe9da-9af6-46cc-aa71-099a63f112ac tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:27 devstack sudo[87142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27
Feb 28 04:43:27 devstack sudo[87142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:27 devstack sudo[87141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc
Feb 28 04:43:27 devstack sudo[87141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:28 devstack sudo[87142]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-185fe9da-9af6-46cc-aa71-099a63f112ac tempest-GroupSnapshotsTest-1988525138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27" returned: 0 in 0.562s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-185fe9da-9af6-46cc-aa71-099a63f112ac tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:28 devstack sudo[87141]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e3a9c84d-6667-4045-a3e0-126cbb7c7299 tempest-SnapshotsActionsTest-1355677458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc" returned: 0 in 0.660s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:28 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-e3a9c84d-6667-4045-a3e0-126cbb7c7299 tempest-SnapshotsActionsTest-1355677458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a27a465-7230-4e68-9540-285c134cf1c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:43:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e3a9c84d-6667-4045-a3e0-126cbb7c7299 tempest-SnapshotsActionsTest-1355677458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.d9a2a56c-cfd9-48b7-9141-9fdedc95d43d 1G {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:28 devstack sudo[87166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27
Feb 28 04:43:28 devstack sudo[87166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:28 devstack sudo[87167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.d9a2a56c-cfd9-48b7-9141-9fdedc95d43d 1G
Feb 28 04:43:28 devstack sudo[87167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:28 devstack sudo[87166]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-185fe9da-9af6-46cc-aa71-099a63f112ac tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27" returned: 0 in 0.483s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:28 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-185fe9da-9af6-46cc-aa71-099a63f112ac tempest-GroupSnapshotsTest-1988525138 None] Lock "cinder-quobyte-2b69a8bf-8f4b-4ff7-ad3a-bdd1fe0c9f27" released by "delete_volume" :: held 1.073s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:43:28 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-185fe9da-9af6-46cc-aa71-099a63f112ac tempest-GroupSnapshotsTest-1988525138 None] Acquiring lock "cinder-quobyte-a7913619-1daf-46ed-85c1-1703d6a97298" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:43:28 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-185fe9da-9af6-46cc-aa71-099a63f112ac tempest-GroupSnapshotsTest-1988525138 None] Lock "cinder-quobyte-a7913619-1daf-46ed-85c1-1703d6a97298" acquired by "delete_volume" :: waited 0.005s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:43:28 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7d4edd-6706-4b50-81a8-df1533c69ba6]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:43:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-185fe9da-9af6-46cc-aa71-099a63f112ac tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:28 devstack sudo[87174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298
Feb 28 04:43:28 devstack sudo[87174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:28 devstack sudo[87167]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e3a9c84d-6667-4045-a3e0-126cbb7c7299 tempest-SnapshotsActionsTest-1355677458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.d9a2a56c-cfd9-48b7-9141-9fdedc95d43d 1G" returned: 0 in 0.671s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e3a9c84d-6667-4045-a3e0-126cbb7c7299 tempest-SnapshotsActionsTest-1355677458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.d9a2a56c-cfd9-48b7-9141-9fdedc95d43d {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:28 devstack sudo[87176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.d9a2a56c-cfd9-48b7-9141-9fdedc95d43d
Feb 28 04:43:28 devstack sudo[87176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:29 devstack sudo[87174]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-185fe9da-9af6-46cc-aa71-099a63f112ac tempest-GroupSnapshotsTest-1988525138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298" returned: 0 in 0.604s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-185fe9da-9af6-46cc-aa71-099a63f112ac tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:29 devstack sudo[87184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298
Feb 28 04:43:29 devstack sudo[87184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:29 devstack sudo[87176]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e3a9c84d-6667-4045-a3e0-126cbb7c7299 tempest-SnapshotsActionsTest-1355677458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.d9a2a56c-cfd9-48b7-9141-9fdedc95d43d" returned: 0 in 0.503s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:29 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-e3a9c84d-6667-4045-a3e0-126cbb7c7299 tempest-SnapshotsActionsTest-1355677458 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.d9a2a56c-cfd9-48b7-9141-9fdedc95d43d is being set with open permissions: ugo+rw
Feb 28 04:43:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e3a9c84d-6667-4045-a3e0-126cbb7c7299 tempest-SnapshotsActionsTest-1355677458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.d9a2a56c-cfd9-48b7-9141-9fdedc95d43d {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:29 devstack sudo[87186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.d9a2a56c-cfd9-48b7-9141-9fdedc95d43d
Feb 28 04:43:29 devstack sudo[87186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:29 devstack sudo[87184]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-185fe9da-9af6-46cc-aa71-099a63f112ac tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a7913619-1daf-46ed-85c1-1703d6a97298" returned: 0 in 0.431s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:29 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-185fe9da-9af6-46cc-aa71-099a63f112ac tempest-GroupSnapshotsTest-1988525138 None] Lock "cinder-quobyte-a7913619-1daf-46ed-85c1-1703d6a97298" released by "delete_volume" :: held 1.075s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:43:29 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-185fe9da-9af6-46cc-aa71-099a63f112ac tempest-GroupSnapshotsTest-1988525138 None] Created reservations ['ef988c90-ab26-4784-9457-20795e621e57'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:43:29 devstack sudo[87186]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e3a9c84d-6667-4045-a3e0-126cbb7c7299 tempest-SnapshotsActionsTest-1355677458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.d9a2a56c-cfd9-48b7-9141-9fdedc95d43d" returned: 0 in 0.453s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:29 devstack cinder-volume[84248]: WARNING cinder.quota [None req-185fe9da-9af6-46cc-aa71-099a63f112ac tempest-GroupSnapshotsTest-1988525138 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1202035307 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1202035307, it is now deprecated. Please use the default quota class for default quota.
Feb 28 04:43:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e3a9c84d-6667-4045-a3e0-126cbb7c7299 tempest-SnapshotsActionsTest-1355677458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.373s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:43:29 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-e3a9c84d-6667-4045-a3e0-126cbb7c7299 tempest-SnapshotsActionsTest-1355677458 None] Create snapshot completed successfully
Feb 28 04:43:29 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-185fe9da-9af6-46cc-aa71-099a63f112ac tempest-GroupSnapshotsTest-1988525138 None] Created reservations ['dfd6612c-9f4d-4d4d-a4a4-9be7eae66386', '9e7b6e0f-c54b-466d-a333-752fb0d07142', 'b8209970-b2ce-40ba-be47-b6675f1c880c', '7516a96b-5f12-4427-8395-3ffd1df942ee'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:43:30 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-185fe9da-9af6-46cc-aa71-099a63f112ac tempest-GroupSnapshotsTest-1988525138 None] Created reservations ['59177dcb-ef79-4f27-bdaf-1430de23ef87', 'cc645bde-040b-43d8-bdc9-84f5f53de6fd', '18ee9ce6-b8af-400e-a18a-21d306407141', 'b71f2bb4-c658-431c-ad4c-231c494c8153'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:43:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-185fe9da-9af6-46cc-aa71-099a63f112ac tempest-GroupSnapshotsTest-1988525138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:43:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-185fe9da-9af6-46cc-aa71-099a63f112ac tempest-GroupSnapshotsTest-1988525138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:43:30 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-185fe9da-9af6-46cc-aa71-099a63f112ac tempest-GroupSnapshotsTest-1988525138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:43:30 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-185fe9da-9af6-46cc-aa71-099a63f112ac tempest-GroupSnapshotsTest-1988525138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:43:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-185fe9da-9af6-46cc-aa71-099a63f112ac tempest-GroupSnapshotsTest-1988525138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:43:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-185fe9da-9af6-46cc-aa71-099a63f112ac tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:30 devstack sudo[87191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:43:30 devstack sudo[87191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:30 devstack sudo[87191]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-185fe9da-9af6-46cc-aa71-099a63f112ac tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.479s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:30 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-185fe9da-9af6-46cc-aa71-099a63f112ac tempest-GroupSnapshotsTest-1988525138 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:43:30 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-185fe9da-9af6-46cc-aa71-099a63f112ac tempest-GroupSnapshotsTest-1988525138 None] Delete group completed successfully.
Feb 28 04:43:30 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-7ef500fc-3ef4-4d8e-bc36-b32edcaa4d69 tempest-SnapshotsActionsTest-1818712012 None] Acquiring lock "cinder-d9a2a56c-cfd9-48b7-9141-9fdedc95d43d-delete_snapshot" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:43:30 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-7ef500fc-3ef4-4d8e-bc36-b32edcaa4d69 tempest-SnapshotsActionsTest-1818712012 None] Lock "cinder-d9a2a56c-cfd9-48b7-9141-9fdedc95d43d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:43:30 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-7ef500fc-3ef4-4d8e-bc36-b32edcaa4d69 tempest-SnapshotsActionsTest-1818712012 None] Acquiring lock "cinder-quobyte-0a27a465-7230-4e68-9540-285c134cf1c5" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:43:30 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-7ef500fc-3ef4-4d8e-bc36-b32edcaa4d69 tempest-SnapshotsActionsTest-1818712012 None] Lock "cinder-quobyte-0a27a465-7230-4e68-9540-285c134cf1c5" acquired by "delete_snapshot" :: waited 0.012s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:43:30 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-7ef500fc-3ef4-4d8e-bc36-b32edcaa4d69 tempest-SnapshotsActionsTest-1818712012 None] Acquiring lock "cinder-quobyte-d9a2a56c-cfd9-48b7-9141-9fdedc95d43d" by "_delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:43:30 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-7ef500fc-3ef4-4d8e-bc36-b32edcaa4d69 tempest-SnapshotsActionsTest-1818712012 None] Lock "cinder-quobyte-d9a2a56c-cfd9-48b7-9141-9fdedc95d43d" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:43:30 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-7ef500fc-3ef4-4d8e-bc36-b32edcaa4d69 tempest-SnapshotsActionsTest-1818712012 None] Deleting offline snapshot d9a2a56c-cfd9-48b7-9141-9fdedc95d43d of volume 0a27a465-7230-4e68-9540-285c134cf1c5 {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 04:43:30 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-7ef500fc-3ef4-4d8e-bc36-b32edcaa4d69 tempest-SnapshotsActionsTest-1818712012 None] snapshot_file for this snap is: volume-0a27a465-7230-4e68-9540-285c134cf1c5.d9a2a56c-cfd9-48b7-9141-9fdedc95d43d {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 04:43:30 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[42afc7f6-6bbe-4dc6-9ccc-7ebacf33db1d]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:43:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7ef500fc-3ef4-4d8e-bc36-b32edcaa4d69 tempest-SnapshotsActionsTest-1818712012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.d9a2a56c-cfd9-48b7-9141-9fdedc95d43d {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:31 devstack sudo[87194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.d9a2a56c-cfd9-48b7-9141-9fdedc95d43d
Feb 28 04:43:31 devstack sudo[87194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:31 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-e92065ff-2719-46f8-821a-26cde7cfc2de tempest-GroupSnapshotsTest-1988525138 None] Group tempest-GroupSnapshotsTest-Group-717559995: creating
Feb 28 04:43:31 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-e92065ff-2719-46f8-821a-26cde7cfc2de tempest-GroupSnapshotsTest-1988525138 None] Group tempest-GroupSnapshotsTest-Group-717559995: created successfully
Feb 28 04:43:31 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-e92065ff-2719-46f8-821a-26cde7cfc2de tempest-GroupSnapshotsTest-1988525138 None] Create group completed successfully.
Feb 28 04:43:31 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ba7fce4-a5fc-4e24-9f30-d57e36f1ea32 tempest-VolumeQuotasAdminTestJSON-263706035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:43:31 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6ba7fce4-a5fc-4e24-9f30-d57e36f1ea32 tempest-VolumeQuotasAdminTestJSON-263706035 None] Flow 'volume_create_manager' (4affc0a5-ba1a-4411-b2bb-61e82f8ae890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:43:31 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6ba7fce4-a5fc-4e24-9f30-d57e36f1ea32 tempest-VolumeQuotasAdminTestJSON-263706035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eacba6c9-b0f9-421b-9311-cedfaf7f95b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:31 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6ba7fce4-a5fc-4e24-9f30-d57e36f1ea32 tempest-VolumeQuotasAdminTestJSON-263706035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eacba6c9-b0f9-421b-9311-cedfaf7f95b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-169688531',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c6ef023-6ab7-4355-a7d8-e6b100f9b808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a92327b915a4454d9a38261026134d9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:43:31Z,use_quota=True,user_id='1d301c3ae12e4036b407cf5099caa922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:31 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6ba7fce4-a5fc-4e24-9f30-d57e36f1ea32 tempest-VolumeQuotasAdminTestJSON-263706035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dfb0f68-07b2-47f7-89c2-9f3d4e8e10ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:31 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6ba7fce4-a5fc-4e24-9f30-d57e36f1ea32 tempest-VolumeQuotasAdminTestJSON-263706035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dfb0f68-07b2-47f7-89c2-9f3d4e8e10ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:31 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6ba7fce4-a5fc-4e24-9f30-d57e36f1ea32 tempest-VolumeQuotasAdminTestJSON-263706035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a0dcd43-2c93-4274-9e3c-b572c38aa25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:31 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6ba7fce4-a5fc-4e24-9f30-d57e36f1ea32 tempest-VolumeQuotasAdminTestJSON-263706035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a0dcd43-2c93-4274-9e3c-b572c38aa25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c6ef023-6ab7-4355-a7d8-e6b100f9b808', 'volume_name': 'volume-6c6ef023-6ab7-4355-a7d8-e6b100f9b808', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:31 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6ba7fce4-a5fc-4e24-9f30-d57e36f1ea32 tempest-VolumeQuotasAdminTestJSON-263706035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb2c3ea8-d402-4e75-887b-8daa110b0f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:31 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6ba7fce4-a5fc-4e24-9f30-d57e36f1ea32 tempest-VolumeQuotasAdminTestJSON-263706035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb2c3ea8-d402-4e75-887b-8daa110b0f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:31 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6ba7fce4-a5fc-4e24-9f30-d57e36f1ea32 tempest-VolumeQuotasAdminTestJSON-263706035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (117c940d-57e0-45c3-b453-15c523e9cb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:31 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-6ba7fce4-a5fc-4e24-9f30-d57e36f1ea32 tempest-VolumeQuotasAdminTestJSON-263706035 None] Volume 6c6ef023-6ab7-4355-a7d8-e6b100f9b808: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c6ef023-6ab7-4355-a7d8-e6b100f9b808', 'volume_size': 1}
Feb 28 04:43:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-6ba7fce4-a5fc-4e24-9f30-d57e36f1ea32 tempest-VolumeQuotasAdminTestJSON-263706035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:43:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-6ba7fce4-a5fc-4e24-9f30-d57e36f1ea32 tempest-VolumeQuotasAdminTestJSON-263706035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:43:31 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-6ba7fce4-a5fc-4e24-9f30-d57e36f1ea32 tempest-VolumeQuotasAdminTestJSON-263706035 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-169688531',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c6ef023-6ab7-4355-a7d8-e6b100f9b808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a92327b915a4454d9a38261026134d9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:43:31Z,use_quota=True,user_id='1d301c3ae12e4036b407cf5099caa922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:43:31 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-6ba7fce4-a5fc-4e24-9f30-d57e36f1ea32 tempest-VolumeQuotasAdminTestJSON-263706035 None] Creating volume 6c6ef023-6ab7-4355-a7d8-e6b100f9b808 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:43:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-6ba7fce4-a5fc-4e24-9f30-d57e36f1ea32 tempest-VolumeQuotasAdminTestJSON-263706035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:43:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-6ba7fce4-a5fc-4e24-9f30-d57e36f1ea32 tempest-VolumeQuotasAdminTestJSON-263706035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:43:31 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-6ba7fce4-a5fc-4e24-9f30-d57e36f1ea32 tempest-VolumeQuotasAdminTestJSON-263706035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:43:31 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-6ba7fce4-a5fc-4e24-9f30-d57e36f1ea32 tempest-VolumeQuotasAdminTestJSON-263706035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:43:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-6ba7fce4-a5fc-4e24-9f30-d57e36f1ea32 tempest-VolumeQuotasAdminTestJSON-263706035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:43:31 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-6ba7fce4-a5fc-4e24-9f30-d57e36f1ea32 tempest-VolumeQuotasAdminTestJSON-263706035 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:43:31 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-6ba7fce4-a5fc-4e24-9f30-d57e36f1ea32 tempest-VolumeQuotasAdminTestJSON-263706035 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:43:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6ba7fce4-a5fc-4e24-9f30-d57e36f1ea32 tempest-VolumeQuotasAdminTestJSON-263706035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6c6ef023-6ab7-4355-a7d8-e6b100f9b808 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:31 devstack sudo[87199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6c6ef023-6ab7-4355-a7d8-e6b100f9b808 1073741824
Feb 28 04:43:31 devstack sudo[87199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:31 devstack sudo[87194]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7ef500fc-3ef4-4d8e-bc36-b32edcaa4d69 tempest-SnapshotsActionsTest-1818712012 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.d9a2a56c-cfd9-48b7-9141-9fdedc95d43d" returned: 0 in 0.571s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:31 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-7ef500fc-3ef4-4d8e-bc36-b32edcaa4d69 tempest-SnapshotsActionsTest-1818712012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a27a465-7230-4e68-9540-285c134cf1c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:43:31 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af05280-97bf-4685-9b56-f978a79183ed]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:43:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7ef500fc-3ef4-4d8e-bc36-b32edcaa4d69 tempest-SnapshotsActionsTest-1818712012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:31 devstack sudo[87201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc
Feb 28 04:43:31 devstack sudo[87201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:31 devstack sudo[87199]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6ba7fce4-a5fc-4e24-9f30-d57e36f1ea32 tempest-VolumeQuotasAdminTestJSON-263706035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6c6ef023-6ab7-4355-a7d8-e6b100f9b808 1073741824" returned: 0 in 0.518s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6ba7fce4-a5fc-4e24-9f30-d57e36f1ea32 tempest-VolumeQuotasAdminTestJSON-263706035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6c6ef023-6ab7-4355-a7d8-e6b100f9b808 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:31 devstack sudo[87209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6c6ef023-6ab7-4355-a7d8-e6b100f9b808
Feb 28 04:43:32 devstack sudo[87209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:32 devstack sudo[87201]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7ef500fc-3ef4-4d8e-bc36-b32edcaa4d69 tempest-SnapshotsActionsTest-1818712012 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc" returned: 0 in 0.518s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:32 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-7ef500fc-3ef4-4d8e-bc36-b32edcaa4d69 tempest-SnapshotsActionsTest-1818712012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a27a465-7230-4e68-9540-285c134cf1c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:43:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7ef500fc-3ef4-4d8e-bc36-b32edcaa4d69 tempest-SnapshotsActionsTest-1818712012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.d9a2a56c-cfd9-48b7-9141-9fdedc95d43d {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:32 devstack sudo[87211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.d9a2a56c-cfd9-48b7-9141-9fdedc95d43d
Feb 28 04:43:32 devstack sudo[87211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:32 devstack sudo[87209]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6ba7fce4-a5fc-4e24-9f30-d57e36f1ea32 tempest-VolumeQuotasAdminTestJSON-263706035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6c6ef023-6ab7-4355-a7d8-e6b100f9b808" returned: 0 in 0.409s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:32 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-6ba7fce4-a5fc-4e24-9f30-d57e36f1ea32 tempest-VolumeQuotasAdminTestJSON-263706035 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:43:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-6ba7fce4-a5fc-4e24-9f30-d57e36f1ea32 tempest-VolumeQuotasAdminTestJSON-263706035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:43:32 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6ba7fce4-a5fc-4e24-9f30-d57e36f1ea32 tempest-VolumeQuotasAdminTestJSON-263706035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (117c940d-57e0-45c3-b453-15c523e9cb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c6ef023-6ab7-4355-a7d8-e6b100f9b808', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:32 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6ba7fce4-a5fc-4e24-9f30-d57e36f1ea32 tempest-VolumeQuotasAdminTestJSON-263706035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dcc8d1f-e4b3-4c03-8252-0bec5f7dd6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:32 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-6ba7fce4-a5fc-4e24-9f30-d57e36f1ea32 tempest-VolumeQuotasAdminTestJSON-263706035 None] Volume volume-6c6ef023-6ab7-4355-a7d8-e6b100f9b808 (6c6ef023-6ab7-4355-a7d8-e6b100f9b808): created successfully
Feb 28 04:43:32 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6ba7fce4-a5fc-4e24-9f30-d57e36f1ea32 tempest-VolumeQuotasAdminTestJSON-263706035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dcc8d1f-e4b3-4c03-8252-0bec5f7dd6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:32 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6ba7fce4-a5fc-4e24-9f30-d57e36f1ea32 tempest-VolumeQuotasAdminTestJSON-263706035 None] Flow 'volume_create_manager' (4affc0a5-ba1a-4411-b2bb-61e82f8ae890) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:43:32 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-6ba7fce4-a5fc-4e24-9f30-d57e36f1ea32 tempest-VolumeQuotasAdminTestJSON-263706035 None] Created volume successfully.
Feb 28 04:43:32 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-43aa6948-39f6-414d-a909-52951e9f8239 tempest-GroupSnapshotsTest-1988525138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:43:32 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-43aa6948-39f6-414d-a909-52951e9f8239 tempest-GroupSnapshotsTest-1988525138 None] Flow 'volume_create_manager' (7a3bd777-3de7-4ed6-a673-adda8c0a8953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:43:32 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-43aa6948-39f6-414d-a909-52951e9f8239 tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06899e60-f718-4d9c-951e-ac194f4ca876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:32 devstack sudo[87211]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:32 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-43aa6948-39f6-414d-a909-52951e9f8239 tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06899e60-f718-4d9c-951e-ac194f4ca876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-473917518',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b0c57d9a-ffc6-462d-bcf4-4fcf05ce2cc3,host='devstack@QuobyteHD#QuobyteHD',id=4921dbcc-1873-473d-a43c-275f3a708ca7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e1e121bb1f4469b9c38572b5eafe4ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:43:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:43:33Z,use_quota=True,user_id='ce45ee3e0a5848dea508be3d13e513bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a049c2-181c-4d88-a285-4fc6a8a4fa7f),volume_type_id=21a049c2-181c-4d88-a285-4fc6a8a4fa7f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:32 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-43aa6948-39f6-414d-a909-52951e9f8239 tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dbf2cd9-b1b6-4641-a28a-1a8ee2eb67d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:32 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-43aa6948-39f6-414d-a909-52951e9f8239 tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dbf2cd9-b1b6-4641-a28a-1a8ee2eb67d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:32 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-43aa6948-39f6-414d-a909-52951e9f8239 tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d99d51c4-3bf1-474a-afe4-10f0a0d05f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:32 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-43aa6948-39f6-414d-a909-52951e9f8239 tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d99d51c4-3bf1-474a-afe4-10f0a0d05f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4921dbcc-1873-473d-a43c-275f3a708ca7', 'volume_name': 'volume-4921dbcc-1873-473d-a43c-275f3a708ca7', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:32 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-43aa6948-39f6-414d-a909-52951e9f8239 tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a728f838-5522-43d7-9f04-98f7b83c2e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:32 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-43aa6948-39f6-414d-a909-52951e9f8239 tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a728f838-5522-43d7-9f04-98f7b83c2e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:32 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-43aa6948-39f6-414d-a909-52951e9f8239 tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2979f8f7-6fe4-45c3-b7ec-c29c97a56149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:32 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-43aa6948-39f6-414d-a909-52951e9f8239 tempest-GroupSnapshotsTest-1988525138 None] Volume 4921dbcc-1873-473d-a43c-275f3a708ca7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4921dbcc-1873-473d-a43c-275f3a708ca7', 'volume_size': 1}
Feb 28 04:43:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-43aa6948-39f6-414d-a909-52951e9f8239 tempest-GroupSnapshotsTest-1988525138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:43:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-43aa6948-39f6-414d-a909-52951e9f8239 tempest-GroupSnapshotsTest-1988525138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:43:32 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-43aa6948-39f6-414d-a909-52951e9f8239 tempest-GroupSnapshotsTest-1988525138 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b0c57d9a-ffc6-462d-bcf4-4fcf05ce2cc3,created_at=2026-02-28T03:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-473917518',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b0c57d9a-ffc6-462d-bcf4-4fcf05ce2cc3,host='devstack@QuobyteHD#QuobyteHD',id=4921dbcc-1873-473d-a43c-275f3a708ca7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e1e121bb1f4469b9c38572b5eafe4ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:43:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:43:33Z,use_quota=True,user_id='ce45ee3e0a5848dea508be3d13e513bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a049c2-181c-4d88-a285-4fc6a8a4fa7f),volume_type_id=21a049c2-181c-4d88-a285-4fc6a8a4fa7f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:43:32 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-43aa6948-39f6-414d-a909-52951e9f8239 tempest-GroupSnapshotsTest-1988525138 None] Creating volume 4921dbcc-1873-473d-a43c-275f3a708ca7 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:43:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-43aa6948-39f6-414d-a909-52951e9f8239 tempest-GroupSnapshotsTest-1988525138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:43:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-43aa6948-39f6-414d-a909-52951e9f8239 tempest-GroupSnapshotsTest-1988525138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:43:32 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-43aa6948-39f6-414d-a909-52951e9f8239 tempest-GroupSnapshotsTest-1988525138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:43:32 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-43aa6948-39f6-414d-a909-52951e9f8239 tempest-GroupSnapshotsTest-1988525138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:43:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-43aa6948-39f6-414d-a909-52951e9f8239 tempest-GroupSnapshotsTest-1988525138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:43:32 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-43aa6948-39f6-414d-a909-52951e9f8239 tempest-GroupSnapshotsTest-1988525138 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:43:32 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-43aa6948-39f6-414d-a909-52951e9f8239 tempest-GroupSnapshotsTest-1988525138 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:43:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-43aa6948-39f6-414d-a909-52951e9f8239 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7ef500fc-3ef4-4d8e-bc36-b32edcaa4d69 tempest-SnapshotsActionsTest-1818712012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.d9a2a56c-cfd9-48b7-9141-9fdedc95d43d" returned: 0 in 0.905s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7ef500fc-3ef4-4d8e-bc36-b32edcaa4d69 tempest-SnapshotsActionsTest-1818712012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.d9a2a56c-cfd9-48b7-9141-9fdedc95d43d {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:32 devstack sudo[87243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7 1073741824
Feb 28 04:43:32 devstack sudo[87243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:32 devstack sudo[87244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.d9a2a56c-cfd9-48b7-9141-9fdedc95d43d
Feb 28 04:43:32 devstack sudo[87244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:33 devstack sudo[87244]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7ef500fc-3ef4-4d8e-bc36-b32edcaa4d69 tempest-SnapshotsActionsTest-1818712012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.d9a2a56c-cfd9-48b7-9141-9fdedc95d43d" returned: 0 in 0.523s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:33 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-7ef500fc-3ef4-4d8e-bc36-b32edcaa4d69 tempest-SnapshotsActionsTest-1818712012 None] Lock "cinder-quobyte-d9a2a56c-cfd9-48b7-9141-9fdedc95d43d" released by "_delete_snapshot" :: held 2.599s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:43:33 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-7ef500fc-3ef4-4d8e-bc36-b32edcaa4d69 tempest-SnapshotsActionsTest-1818712012 None] Lock "cinder-quobyte-0a27a465-7230-4e68-9540-285c134cf1c5" released by "delete_snapshot" :: held 2.655s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:43:33 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-7ef500fc-3ef4-4d8e-bc36-b32edcaa4d69 tempest-SnapshotsActionsTest-1818712012 None] Created reservations ['8c58e6f4-bb1f-497b-abc5-e2740e21d03e', '05130a0a-1710-4c1b-b4e7-762d48d7e1ed', '1379a337-ec67-48e7-935e-0960206d3f57', 'afa5c518-e86b-43fc-b57d-be0766c5de72'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:43:33 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6ef2abc4-9a7a-4b9e-a009-cc3be2cb6909 tempest-VolumeQuotasAdminTestJSON-263706035 None] Acquiring lock "cinder-6c6ef023-6ab7-4355-a7d8-e6b100f9b808-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:43:33 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-7ef500fc-3ef4-4d8e-bc36-b32edcaa4d69 tempest-SnapshotsActionsTest-1818712012 None] Delete snapshot completed successfully.
Feb 28 04:43:33 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-7ef500fc-3ef4-4d8e-bc36-b32edcaa4d69 tempest-SnapshotsActionsTest-1818712012 None] Lock "cinder-d9a2a56c-cfd9-48b7-9141-9fdedc95d43d-delete_snapshot" released by "delete_snapshot" :: held 2.785s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:43:33 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6ef2abc4-9a7a-4b9e-a009-cc3be2cb6909 tempest-VolumeQuotasAdminTestJSON-263706035 None] Lock "cinder-6c6ef023-6ab7-4355-a7d8-e6b100f9b808-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:43:33 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6ef2abc4-9a7a-4b9e-a009-cc3be2cb6909 tempest-VolumeQuotasAdminTestJSON-263706035 None] Acquiring lock "cinder-quobyte-6c6ef023-6ab7-4355-a7d8-e6b100f9b808" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:43:33 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6ef2abc4-9a7a-4b9e-a009-cc3be2cb6909 tempest-VolumeQuotasAdminTestJSON-263706035 None] Lock "cinder-quobyte-6c6ef023-6ab7-4355-a7d8-e6b100f9b808" acquired by "delete_volume" :: waited 0.009s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:43:33 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[442e943f-e1ba-46be-a79d-8055b52ebd62]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:43:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6ef2abc4-9a7a-4b9e-a009-cc3be2cb6909 tempest-VolumeQuotasAdminTestJSON-263706035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6c6ef023-6ab7-4355-a7d8-e6b100f9b808 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:33 devstack sudo[87243]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-43aa6948-39f6-414d-a909-52951e9f8239 tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7 1073741824" returned: 0 in 0.753s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-43aa6948-39f6-414d-a909-52951e9f8239 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:33 devstack sudo[87254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7
Feb 28 04:43:33 devstack sudo[87254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:33 devstack sudo[87253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6c6ef023-6ab7-4355-a7d8-e6b100f9b808
Feb 28 04:43:33 devstack sudo[87253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:34 devstack sudo[87254]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-43aa6948-39f6-414d-a909-52951e9f8239 tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7" returned: 0 in 0.624s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:34 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-43aa6948-39f6-414d-a909-52951e9f8239 tempest-GroupSnapshotsTest-1988525138 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:43:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-43aa6948-39f6-414d-a909-52951e9f8239 tempest-GroupSnapshotsTest-1988525138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.468s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:43:34 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-43aa6948-39f6-414d-a909-52951e9f8239 tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2979f8f7-6fe4-45c3-b7ec-c29c97a56149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4921dbcc-1873-473d-a43c-275f3a708ca7', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:34 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-43aa6948-39f6-414d-a909-52951e9f8239 tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10977b04-0721-40b0-a7f4-d08c75a57c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:34 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-43aa6948-39f6-414d-a909-52951e9f8239 tempest-GroupSnapshotsTest-1988525138 None] Volume volume-4921dbcc-1873-473d-a43c-275f3a708ca7 (4921dbcc-1873-473d-a43c-275f3a708ca7): created successfully
Feb 28 04:43:34 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-43aa6948-39f6-414d-a909-52951e9f8239 tempest-GroupSnapshotsTest-1988525138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10977b04-0721-40b0-a7f4-d08c75a57c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:34 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-43aa6948-39f6-414d-a909-52951e9f8239 tempest-GroupSnapshotsTest-1988525138 None] Flow 'volume_create_manager' (7a3bd777-3de7-4ed6-a673-adda8c0a8953) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:43:34 devstack sudo[87253]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6ef2abc4-9a7a-4b9e-a009-cc3be2cb6909 tempest-VolumeQuotasAdminTestJSON-263706035 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6c6ef023-6ab7-4355-a7d8-e6b100f9b808" returned: 0 in 0.770s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6ef2abc4-9a7a-4b9e-a009-cc3be2cb6909 tempest-VolumeQuotasAdminTestJSON-263706035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6c6ef023-6ab7-4355-a7d8-e6b100f9b808 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:34 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-43aa6948-39f6-414d-a909-52951e9f8239 tempest-GroupSnapshotsTest-1988525138 None] Created volume successfully.
Feb 28 04:43:34 devstack sudo[87274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6c6ef023-6ab7-4355-a7d8-e6b100f9b808
Feb 28 04:43:34 devstack sudo[87274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:34 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-a6d100cd-ebae-44f9-a303-56b2f41da918 tempest-SnapshotsActionsTest-1355677458 None] Acquiring lock "cinder-66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc-delete_snapshot" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:43:34 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-a6d100cd-ebae-44f9-a303-56b2f41da918 tempest-SnapshotsActionsTest-1355677458 None] Lock "cinder-66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:43:34 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-a6d100cd-ebae-44f9-a303-56b2f41da918 tempest-SnapshotsActionsTest-1355677458 None] Acquiring lock "cinder-quobyte-0a27a465-7230-4e68-9540-285c134cf1c5" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:43:34 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-a6d100cd-ebae-44f9-a303-56b2f41da918 tempest-SnapshotsActionsTest-1355677458 None] Lock "cinder-quobyte-0a27a465-7230-4e68-9540-285c134cf1c5" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:43:34 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-a6d100cd-ebae-44f9-a303-56b2f41da918 tempest-SnapshotsActionsTest-1355677458 None] Acquiring lock "cinder-quobyte-66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc" by "_delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:43:34 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-a6d100cd-ebae-44f9-a303-56b2f41da918 tempest-SnapshotsActionsTest-1355677458 None] Lock "cinder-quobyte-66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:43:34 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-a6d100cd-ebae-44f9-a303-56b2f41da918 tempest-SnapshotsActionsTest-1355677458 None] Deleting offline snapshot 66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc of volume 0a27a465-7230-4e68-9540-285c134cf1c5 {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 04:43:34 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-a6d100cd-ebae-44f9-a303-56b2f41da918 tempest-SnapshotsActionsTest-1355677458 None] snapshot_file for this snap is: volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 04:43:34 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f19d5c1-4fea-4440-8b90-a181728f7f26]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:43:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a6d100cd-ebae-44f9-a303-56b2f41da918 tempest-SnapshotsActionsTest-1355677458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:34 devstack sudo[87279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc
Feb 28 04:43:34 devstack sudo[87279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:35 devstack sudo[87274]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6ef2abc4-9a7a-4b9e-a009-cc3be2cb6909 tempest-VolumeQuotasAdminTestJSON-263706035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6c6ef023-6ab7-4355-a7d8-e6b100f9b808" returned: 0 in 0.674s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:35 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6ef2abc4-9a7a-4b9e-a009-cc3be2cb6909 tempest-VolumeQuotasAdminTestJSON-263706035 None] Lock "cinder-quobyte-6c6ef023-6ab7-4355-a7d8-e6b100f9b808" released by "delete_volume" :: held 1.468s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:43:35 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-6ef2abc4-9a7a-4b9e-a009-cc3be2cb6909 tempest-VolumeQuotasAdminTestJSON-263706035 None] Created reservations ['f6b2feba-9538-4fd5-ae55-119ada7700a7', 'cc2278c9-9919-4b59-b102-409a2fd3288f', '6d1823f3-7105-495e-b6ec-8ee0eb0bbd27', 'b4f5e780-ff17-4b14-b08b-22b6aae2672f'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:43:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-6ef2abc4-9a7a-4b9e-a009-cc3be2cb6909 tempest-VolumeQuotasAdminTestJSON-263706035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:43:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-6ef2abc4-9a7a-4b9e-a009-cc3be2cb6909 tempest-VolumeQuotasAdminTestJSON-263706035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:43:35 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-6ef2abc4-9a7a-4b9e-a009-cc3be2cb6909 tempest-VolumeQuotasAdminTestJSON-263706035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:43:35 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-6ef2abc4-9a7a-4b9e-a009-cc3be2cb6909 tempest-VolumeQuotasAdminTestJSON-263706035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:43:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-6ef2abc4-9a7a-4b9e-a009-cc3be2cb6909 tempest-VolumeQuotasAdminTestJSON-263706035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:43:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6ef2abc4-9a7a-4b9e-a009-cc3be2cb6909 tempest-VolumeQuotasAdminTestJSON-263706035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:35 devstack sudo[87285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:43:35 devstack sudo[87285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:35 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-f1b5f32c-2759-4adf-8b41-a7fdeb2a1c70 tempest-GroupSnapshotsTest-1988525138 None] GroupSnapshot 4655ce01-76d9-4c59-9ceb-7e0b29909337: creating.
Feb 28 04:43:35 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-f1b5f32c-2759-4adf-8b41-a7fdeb2a1c70 tempest-GroupSnapshotsTest-1988525138 None] Group snapshot 4655ce01-76d9-4c59-9ceb-7e0b29909337: creating. {{(pid=84248) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Feb 28 04:43:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-f1b5f32c-2759-4adf-8b41-a7fdeb2a1c70 tempest-GroupSnapshotsTest-1988525138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:43:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-f1b5f32c-2759-4adf-8b41-a7fdeb2a1c70 tempest-GroupSnapshotsTest-1988525138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:43:35 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-f1b5f32c-2759-4adf-8b41-a7fdeb2a1c70 tempest-GroupSnapshotsTest-1988525138 None] Creating offline snapshot ef5f282e-1152-414c-8501-0a021b97a121 of volume 4921dbcc-1873-473d-a43c-275f3a708ca7 {{(pid=84248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 04:43:35 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1bcaafb-8554-426c-ab15-1ba9422a6da8]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:43:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f1b5f32c-2759-4adf-8b41-a7fdeb2a1c70 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:35 devstack sudo[87288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7
Feb 28 04:43:35 devstack sudo[87288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:35 devstack sudo[87279]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a6d100cd-ebae-44f9-a303-56b2f41da918 tempest-SnapshotsActionsTest-1355677458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc" returned: 0 in 0.748s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:35 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-a6d100cd-ebae-44f9-a303-56b2f41da918 tempest-SnapshotsActionsTest-1355677458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a27a465-7230-4e68-9540-285c134cf1c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:43:35 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5035dc4-80e4-47be-8002-a56553824ca5]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:43:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a6d100cd-ebae-44f9-a303-56b2f41da918 tempest-SnapshotsActionsTest-1355677458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:35 devstack sudo[87292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5
Feb 28 04:43:35 devstack sudo[87292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:35 devstack sudo[87285]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6ef2abc4-9a7a-4b9e-a009-cc3be2cb6909 tempest-VolumeQuotasAdminTestJSON-263706035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.521s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:35 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-6ef2abc4-9a7a-4b9e-a009-cc3be2cb6909 tempest-VolumeQuotasAdminTestJSON-263706035 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:43:35 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-6ef2abc4-9a7a-4b9e-a009-cc3be2cb6909 tempest-VolumeQuotasAdminTestJSON-263706035 None] Deleted volume successfully.
Feb 28 04:43:35 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6ef2abc4-9a7a-4b9e-a009-cc3be2cb6909 tempest-VolumeQuotasAdminTestJSON-263706035 None] Lock "cinder-6c6ef023-6ab7-4355-a7d8-e6b100f9b808-delete_volume" released by "delete_volume" :: held 2.149s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:43:35 devstack sudo[87288]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f1b5f32c-2759-4adf-8b41-a7fdeb2a1c70 tempest-GroupSnapshotsTest-1988525138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7" returned: 0 in 0.664s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f1b5f32c-2759-4adf-8b41-a7fdeb2a1c70 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7.ef5f282e-1152-414c-8501-0a021b97a121 1G {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:36 devstack sudo[87301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7.ef5f282e-1152-414c-8501-0a021b97a121 1G
Feb 28 04:43:36 devstack sudo[87301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:36 devstack sudo[87292]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a6d100cd-ebae-44f9-a303-56b2f41da918 tempest-SnapshotsActionsTest-1355677458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5" returned: 0 in 0.794s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a6d100cd-ebae-44f9-a303-56b2f41da918 tempest-SnapshotsActionsTest-1355677458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:36 devstack sudo[87303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc
Feb 28 04:43:36 devstack sudo[87303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:36 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3186167-bcce-445d-86f4-0bf9c70b7ca3 tempest-VolumeQuotasAdminTestJSON-263706035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:43:36 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b3186167-bcce-445d-86f4-0bf9c70b7ca3 tempest-VolumeQuotasAdminTestJSON-263706035 None] Flow 'volume_create_manager' (9ba87b44-870f-4c2a-9d0b-d8ccf912a4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:43:36 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b3186167-bcce-445d-86f4-0bf9c70b7ca3 tempest-VolumeQuotasAdminTestJSON-263706035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d151861f-acae-4510-84b5-011dfde0a21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:36 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b3186167-bcce-445d-86f4-0bf9c70b7ca3 tempest-VolumeQuotasAdminTestJSON-263706035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d151861f-acae-4510-84b5-011dfde0a21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-452617927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efe21d65-4f71-4d04-9662-cd72ba1ed57a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a92327b915a4454d9a38261026134d9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:43:36Z,use_quota=True,user_id='1d301c3ae12e4036b407cf5099caa922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:36 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b3186167-bcce-445d-86f4-0bf9c70b7ca3 tempest-VolumeQuotasAdminTestJSON-263706035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5520cddd-0089-4342-9db9-0b59e2cfd2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:36 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b3186167-bcce-445d-86f4-0bf9c70b7ca3 tempest-VolumeQuotasAdminTestJSON-263706035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5520cddd-0089-4342-9db9-0b59e2cfd2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:36 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b3186167-bcce-445d-86f4-0bf9c70b7ca3 tempest-VolumeQuotasAdminTestJSON-263706035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1e12a7a-dd37-4e01-aae1-60f9fb93016a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:36 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b3186167-bcce-445d-86f4-0bf9c70b7ca3 tempest-VolumeQuotasAdminTestJSON-263706035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1e12a7a-dd37-4e01-aae1-60f9fb93016a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efe21d65-4f71-4d04-9662-cd72ba1ed57a', 'volume_name': 'volume-efe21d65-4f71-4d04-9662-cd72ba1ed57a', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:36 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b3186167-bcce-445d-86f4-0bf9c70b7ca3 tempest-VolumeQuotasAdminTestJSON-263706035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e5e9405-fdd6-4345-93b2-b4f01593bf42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:36 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b3186167-bcce-445d-86f4-0bf9c70b7ca3 tempest-VolumeQuotasAdminTestJSON-263706035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e5e9405-fdd6-4345-93b2-b4f01593bf42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:36 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b3186167-bcce-445d-86f4-0bf9c70b7ca3 tempest-VolumeQuotasAdminTestJSON-263706035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d75e4c08-30ab-4bca-8347-d4e6be0bc5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:36 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-b3186167-bcce-445d-86f4-0bf9c70b7ca3 tempest-VolumeQuotasAdminTestJSON-263706035 None] Volume efe21d65-4f71-4d04-9662-cd72ba1ed57a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efe21d65-4f71-4d04-9662-cd72ba1ed57a', 'volume_size': 1}
Feb 28 04:43:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b3186167-bcce-445d-86f4-0bf9c70b7ca3 tempest-VolumeQuotasAdminTestJSON-263706035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:43:36 devstack sudo[87301]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f1b5f32c-2759-4adf-8b41-a7fdeb2a1c70 tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7.ef5f282e-1152-414c-8501-0a021b97a121 1G" returned: 0 in 0.662s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f1b5f32c-2759-4adf-8b41-a7fdeb2a1c70 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4921dbcc-1873-473d-a43c-275f3a708ca7 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7.ef5f282e-1152-414c-8501-0a021b97a121 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:36 devstack sudo[87308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4921dbcc-1873-473d-a43c-275f3a708ca7 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7.ef5f282e-1152-414c-8501-0a021b97a121
Feb 28 04:43:36 devstack sudo[87308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:36 devstack sudo[87303]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a6d100cd-ebae-44f9-a303-56b2f41da918 tempest-SnapshotsActionsTest-1355677458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc" returned: 0 in 0.593s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a6d100cd-ebae-44f9-a303-56b2f41da918 tempest-SnapshotsActionsTest-1355677458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:36 devstack sudo[87313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc
Feb 28 04:43:36 devstack sudo[87313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:37 devstack sudo[87308]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f1b5f32c-2759-4adf-8b41-a7fdeb2a1c70 tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4921dbcc-1873-473d-a43c-275f3a708ca7 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7.ef5f282e-1152-414c-8501-0a021b97a121" returned: 0 in 0.468s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:37 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-f1b5f32c-2759-4adf-8b41-a7fdeb2a1c70 tempest-GroupSnapshotsTest-1988525138 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7.ef5f282e-1152-414c-8501-0a021b97a121 is being set with open permissions: ugo+rw: NotImplementedError
Feb 28 04:43:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f1b5f32c-2759-4adf-8b41-a7fdeb2a1c70 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7.ef5f282e-1152-414c-8501-0a021b97a121 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:37 devstack sudo[87318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7.ef5f282e-1152-414c-8501-0a021b97a121
Feb 28 04:43:37 devstack sudo[87318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:37 devstack sudo[87313]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a6d100cd-ebae-44f9-a303-56b2f41da918 tempest-SnapshotsActionsTest-1355677458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5.66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc" returned: 0 in 0.448s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:37 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-a6d100cd-ebae-44f9-a303-56b2f41da918 tempest-SnapshotsActionsTest-1355677458 None] Lock "cinder-quobyte-66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc" released by "_delete_snapshot" :: held 2.655s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:43:37 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-a6d100cd-ebae-44f9-a303-56b2f41da918 tempest-SnapshotsActionsTest-1355677458 None] Lock "cinder-quobyte-0a27a465-7230-4e68-9540-285c134cf1c5" released by "delete_snapshot" :: held 2.667s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:43:37 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-a6d100cd-ebae-44f9-a303-56b2f41da918 tempest-SnapshotsActionsTest-1355677458 None] Created reservations ['e23880be-cf4e-451f-964c-66d756c3978a', 'ab545e78-a28f-4635-ae2b-cc89df1a81d3', '721f95be-9c64-4797-97ef-b5e771bf43e8', 'cd54d46d-0a2a-49da-be9d-6ff59f442021'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:43:37 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-a6d100cd-ebae-44f9-a303-56b2f41da918 tempest-SnapshotsActionsTest-1355677458 None] Delete snapshot completed successfully.
Feb 28 04:43:37 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-a6d100cd-ebae-44f9-a303-56b2f41da918 tempest-SnapshotsActionsTest-1355677458 None] Lock "cinder-66fb7ab2-d7ff-4e0a-8a6e-dd3575cc4fcc-delete_snapshot" released by "delete_snapshot" :: held 2.781s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:43:37 devstack sudo[87318]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f1b5f32c-2759-4adf-8b41-a7fdeb2a1c70 tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7.ef5f282e-1152-414c-8501-0a021b97a121" returned: 0 in 0.518s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f1b5f32c-2759-4adf-8b41-a7fdeb2a1c70 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:37 devstack sudo[87347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7.info
Feb 28 04:43:37 devstack sudo[87347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:37 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-26b65c18-32f9-41cf-9f75-3b660ba3823a tempest-SnapshotsActionsTest-1355677458 None] Acquiring lock "cinder-0a27a465-7230-4e68-9540-285c134cf1c5-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:43:37 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-26b65c18-32f9-41cf-9f75-3b660ba3823a tempest-SnapshotsActionsTest-1355677458 None] Lock "cinder-0a27a465-7230-4e68-9540-285c134cf1c5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:43:37 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-26b65c18-32f9-41cf-9f75-3b660ba3823a tempest-SnapshotsActionsTest-1355677458 None] Acquiring lock "cinder-quobyte-0a27a465-7230-4e68-9540-285c134cf1c5" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:43:37 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-26b65c18-32f9-41cf-9f75-3b660ba3823a tempest-SnapshotsActionsTest-1355677458 None] Lock "cinder-quobyte-0a27a465-7230-4e68-9540-285c134cf1c5" acquired by "delete_volume" :: waited 0.008s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:43:37 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[5733ee13-83eb-44c0-85c3-7ae917a399f9]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:43:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-26b65c18-32f9-41cf-9f75-3b660ba3823a tempest-SnapshotsActionsTest-1355677458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:38 devstack sudo[87351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5
Feb 28 04:43:38 devstack sudo[87351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:38 devstack sudo[87347]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f1b5f32c-2759-4adf-8b41-a7fdeb2a1c70 tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7.info" returned: 0 in 0.453s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:38 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-f1b5f32c-2759-4adf-8b41-a7fdeb2a1c70 tempest-GroupSnapshotsTest-1988525138 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7.info is being set with open permissions: ugo+rw: NotImplementedError
Feb 28 04:43:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f1b5f32c-2759-4adf-8b41-a7fdeb2a1c70 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:38 devstack sudo[87354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7.info
Feb 28 04:43:38 devstack sudo[87354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:38 devstack sudo[87351]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-26b65c18-32f9-41cf-9f75-3b660ba3823a tempest-SnapshotsActionsTest-1355677458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5" returned: 0 in 0.636s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-26b65c18-32f9-41cf-9f75-3b660ba3823a tempest-SnapshotsActionsTest-1355677458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:38 devstack sudo[87381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5
Feb 28 04:43:38 devstack sudo[87381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:38 devstack sudo[87354]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f1b5f32c-2759-4adf-8b41-a7fdeb2a1c70 tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7.info" returned: 0 in 0.583s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-f1b5f32c-2759-4adf-8b41-a7fdeb2a1c70 tempest-GroupSnapshotsTest-1988525138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.446s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:43:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b3186167-bcce-445d-86f4-0bf9c70b7ca3 tempest-VolumeQuotasAdminTestJSON-263706035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.198s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:43:38 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-b3186167-bcce-445d-86f4-0bf9c70b7ca3 tempest-VolumeQuotasAdminTestJSON-263706035 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-452617927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efe21d65-4f71-4d04-9662-cd72ba1ed57a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a92327b915a4454d9a38261026134d9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:43:36Z,use_quota=True,user_id='1d301c3ae12e4036b407cf5099caa922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:43:38 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-b3186167-bcce-445d-86f4-0bf9c70b7ca3 tempest-VolumeQuotasAdminTestJSON-263706035 None] Creating volume efe21d65-4f71-4d04-9662-cd72ba1ed57a {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:43:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b3186167-bcce-445d-86f4-0bf9c70b7ca3 tempest-VolumeQuotasAdminTestJSON-263706035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:43:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b3186167-bcce-445d-86f4-0bf9c70b7ca3 tempest-VolumeQuotasAdminTestJSON-263706035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:43:38 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-b3186167-bcce-445d-86f4-0bf9c70b7ca3 tempest-VolumeQuotasAdminTestJSON-263706035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:43:38 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-b3186167-bcce-445d-86f4-0bf9c70b7ca3 tempest-VolumeQuotasAdminTestJSON-263706035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:43:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b3186167-bcce-445d-86f4-0bf9c70b7ca3 tempest-VolumeQuotasAdminTestJSON-263706035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:43:38 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-b3186167-bcce-445d-86f4-0bf9c70b7ca3 tempest-VolumeQuotasAdminTestJSON-263706035 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:43:38 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-b3186167-bcce-445d-86f4-0bf9c70b7ca3 tempest-VolumeQuotasAdminTestJSON-263706035 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:43:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b3186167-bcce-445d-86f4-0bf9c70b7ca3 tempest-VolumeQuotasAdminTestJSON-263706035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-efe21d65-4f71-4d04-9662-cd72ba1ed57a 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:38 devstack sudo[87384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-efe21d65-4f71-4d04-9662-cd72ba1ed57a 1073741824
Feb 28 04:43:38 devstack sudo[87384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:38 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-f1b5f32c-2759-4adf-8b41-a7fdeb2a1c70 tempest-GroupSnapshotsTest-1988525138 None] group_snapshot 4655ce01-76d9-4c59-9ceb-7e0b29909337: created successfully
Feb 28 04:43:39 devstack sudo[87381]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-26b65c18-32f9-41cf-9f75-3b660ba3823a tempest-SnapshotsActionsTest-1355677458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0a27a465-7230-4e68-9540-285c134cf1c5" returned: 0 in 0.609s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:39 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-26b65c18-32f9-41cf-9f75-3b660ba3823a tempest-SnapshotsActionsTest-1355677458 None] Lock "cinder-quobyte-0a27a465-7230-4e68-9540-285c134cf1c5" released by "delete_volume" :: held 1.272s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:43:39 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-26b65c18-32f9-41cf-9f75-3b660ba3823a tempest-SnapshotsActionsTest-1355677458 None] Created reservations ['43e22560-59b2-4b32-87bb-5a6af829ccc2', '5339fe2d-4cbc-49a6-978f-eceace94c517', 'd8fbd868-638a-48f1-ac27-fecc3538bb23', '94a1a0ef-b6a6-44b2-bfeb-37c3c09c0c92'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:43:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-26b65c18-32f9-41cf-9f75-3b660ba3823a tempest-SnapshotsActionsTest-1355677458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:43:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-26b65c18-32f9-41cf-9f75-3b660ba3823a tempest-SnapshotsActionsTest-1355677458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:43:39 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-26b65c18-32f9-41cf-9f75-3b660ba3823a tempest-SnapshotsActionsTest-1355677458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:43:39 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-26b65c18-32f9-41cf-9f75-3b660ba3823a tempest-SnapshotsActionsTest-1355677458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:43:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-26b65c18-32f9-41cf-9f75-3b660ba3823a tempest-SnapshotsActionsTest-1355677458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:43:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-26b65c18-32f9-41cf-9f75-3b660ba3823a tempest-SnapshotsActionsTest-1355677458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:39 devstack sudo[87390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:43:39 devstack sudo[87390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:39 devstack sudo[87384]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b3186167-bcce-445d-86f4-0bf9c70b7ca3 tempest-VolumeQuotasAdminTestJSON-263706035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-efe21d65-4f71-4d04-9662-cd72ba1ed57a 1073741824" returned: 0 in 0.601s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b3186167-bcce-445d-86f4-0bf9c70b7ca3 tempest-VolumeQuotasAdminTestJSON-263706035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-efe21d65-4f71-4d04-9662-cd72ba1ed57a {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:39 devstack sudo[87392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-efe21d65-4f71-4d04-9662-cd72ba1ed57a
Feb 28 04:43:39 devstack sudo[87392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:39 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-600e26c4-403c-44b9-a2cf-8d9172e0f074 tempest-GroupSnapshotsTest-1988525138 None] group_snapshot 4655ce01-76d9-4c59-9ceb-7e0b29909337: deleting
Feb 28 04:43:39 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-600e26c4-403c-44b9-a2cf-8d9172e0f074 tempest-GroupSnapshotsTest-1988525138 None] group_snapshot 4655ce01-76d9-4c59-9ceb-7e0b29909337: deleting {{(pid=84248) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Feb 28 04:43:39 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-600e26c4-403c-44b9-a2cf-8d9172e0f074 tempest-GroupSnapshotsTest-1988525138 None] Acquiring lock "cinder-quobyte-4921dbcc-1873-473d-a43c-275f3a708ca7" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:43:39 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-600e26c4-403c-44b9-a2cf-8d9172e0f074 tempest-GroupSnapshotsTest-1988525138 None] Lock "cinder-quobyte-4921dbcc-1873-473d-a43c-275f3a708ca7" acquired by "delete_snapshot" :: waited 0.034s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:43:39 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-600e26c4-403c-44b9-a2cf-8d9172e0f074 tempest-GroupSnapshotsTest-1988525138 None] Acquiring lock "cinder-quobyte-ef5f282e-1152-414c-8501-0a021b97a121" by "_delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:43:39 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-600e26c4-403c-44b9-a2cf-8d9172e0f074 tempest-GroupSnapshotsTest-1988525138 None] Lock "cinder-quobyte-ef5f282e-1152-414c-8501-0a021b97a121" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:43:39 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-600e26c4-403c-44b9-a2cf-8d9172e0f074 tempest-GroupSnapshotsTest-1988525138 None] Deleting offline snapshot ef5f282e-1152-414c-8501-0a021b97a121 of volume 4921dbcc-1873-473d-a43c-275f3a708ca7 {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 04:43:39 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-600e26c4-403c-44b9-a2cf-8d9172e0f074 tempest-GroupSnapshotsTest-1988525138 None] snapshot_file for this snap is: volume-4921dbcc-1873-473d-a43c-275f3a708ca7.ef5f282e-1152-414c-8501-0a021b97a121 {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 04:43:39 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[783f7899-7746-46a4-be9a-d21c06b9eeb3]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:43:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-600e26c4-403c-44b9-a2cf-8d9172e0f074 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7.ef5f282e-1152-414c-8501-0a021b97a121 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:39 devstack sudo[87390]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-26b65c18-32f9-41cf-9f75-3b660ba3823a tempest-SnapshotsActionsTest-1355677458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.579s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:39 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-26b65c18-32f9-41cf-9f75-3b660ba3823a tempest-SnapshotsActionsTest-1355677458 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:43:39 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-26b65c18-32f9-41cf-9f75-3b660ba3823a tempest-SnapshotsActionsTest-1355677458 None] Deleted volume successfully.
Feb 28 04:43:39 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-26b65c18-32f9-41cf-9f75-3b660ba3823a tempest-SnapshotsActionsTest-1355677458 None] Lock "cinder-0a27a465-7230-4e68-9540-285c134cf1c5-delete_volume" released by "delete_volume" :: held 2.028s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:43:39 devstack sudo[87396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7.ef5f282e-1152-414c-8501-0a021b97a121
Feb 28 04:43:39 devstack sudo[87396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:40 devstack sudo[87392]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b3186167-bcce-445d-86f4-0bf9c70b7ca3 tempest-VolumeQuotasAdminTestJSON-263706035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-efe21d65-4f71-4d04-9662-cd72ba1ed57a" returned: 0 in 0.651s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:40 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-b3186167-bcce-445d-86f4-0bf9c70b7ca3 tempest-VolumeQuotasAdminTestJSON-263706035 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:43:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b3186167-bcce-445d-86f4-0bf9c70b7ca3 tempest-VolumeQuotasAdminTestJSON-263706035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.287s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:43:40 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b3186167-bcce-445d-86f4-0bf9c70b7ca3 tempest-VolumeQuotasAdminTestJSON-263706035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d75e4c08-30ab-4bca-8347-d4e6be0bc5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efe21d65-4f71-4d04-9662-cd72ba1ed57a', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:40 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b3186167-bcce-445d-86f4-0bf9c70b7ca3 tempest-VolumeQuotasAdminTestJSON-263706035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e741cb0a-808f-4b71-81ea-a7b6a4103ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:40 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-b3186167-bcce-445d-86f4-0bf9c70b7ca3 tempest-VolumeQuotasAdminTestJSON-263706035 None] Volume volume-efe21d65-4f71-4d04-9662-cd72ba1ed57a (efe21d65-4f71-4d04-9662-cd72ba1ed57a): created successfully
Feb 28 04:43:40 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b3186167-bcce-445d-86f4-0bf9c70b7ca3 tempest-VolumeQuotasAdminTestJSON-263706035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e741cb0a-808f-4b71-81ea-a7b6a4103ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:40 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b3186167-bcce-445d-86f4-0bf9c70b7ca3 tempest-VolumeQuotasAdminTestJSON-263706035 None] Flow 'volume_create_manager' (9ba87b44-870f-4c2a-9d0b-d8ccf912a4c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:43:40 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-b3186167-bcce-445d-86f4-0bf9c70b7ca3 tempest-VolumeQuotasAdminTestJSON-263706035 None] Created volume successfully.
Feb 28 04:43:40 devstack sudo[87396]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-600e26c4-403c-44b9-a2cf-8d9172e0f074 tempest-GroupSnapshotsTest-1988525138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7.ef5f282e-1152-414c-8501-0a021b97a121" returned: 0 in 0.766s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:40 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-600e26c4-403c-44b9-a2cf-8d9172e0f074 tempest-GroupSnapshotsTest-1988525138 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4921dbcc-1873-473d-a43c-275f3a708ca7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:43:40 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[359a66fa-deb1-4f40-90fc-7e8c27a60485]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:43:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-600e26c4-403c-44b9-a2cf-8d9172e0f074 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:40 devstack sudo[87402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7
Feb 28 04:43:40 devstack sudo[87402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:41 devstack sudo[87402]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-600e26c4-403c-44b9-a2cf-8d9172e0f074 tempest-GroupSnapshotsTest-1988525138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7" returned: 0 in 0.657s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-600e26c4-403c-44b9-a2cf-8d9172e0f074 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7.ef5f282e-1152-414c-8501-0a021b97a121 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:41 devstack sudo[87407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7.ef5f282e-1152-414c-8501-0a021b97a121
Feb 28 04:43:41 devstack sudo[87407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:41 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-c2b0a974-ee11-434f-b499-4a185ce08a6a tempest-VolumeQuotasAdminTestJSON-314594424 None] Transfer volume completed successfully.
Feb 28 04:43:41 devstack sudo[87407]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-600e26c4-403c-44b9-a2cf-8d9172e0f074 tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7.ef5f282e-1152-414c-8501-0a021b97a121" returned: 0 in 0.583s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-600e26c4-403c-44b9-a2cf-8d9172e0f074 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7.ef5f282e-1152-414c-8501-0a021b97a121 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:41 devstack sudo[87434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7.ef5f282e-1152-414c-8501-0a021b97a121
Feb 28 04:43:41 devstack sudo[87434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:42 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ef6bec0a-d34d-407a-aa66-ea00d4c320af tempest-VolumeQuotasAdminTestJSON-651676899 None] Acquiring lock "cinder-efe21d65-4f71-4d04-9662-cd72ba1ed57a-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:43:42 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ef6bec0a-d34d-407a-aa66-ea00d4c320af tempest-VolumeQuotasAdminTestJSON-651676899 None] Lock "cinder-efe21d65-4f71-4d04-9662-cd72ba1ed57a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:43:42 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ef6bec0a-d34d-407a-aa66-ea00d4c320af tempest-VolumeQuotasAdminTestJSON-651676899 None] Acquiring lock "cinder-quobyte-efe21d65-4f71-4d04-9662-cd72ba1ed57a" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:43:42 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ef6bec0a-d34d-407a-aa66-ea00d4c320af tempest-VolumeQuotasAdminTestJSON-651676899 None] Lock "cinder-quobyte-efe21d65-4f71-4d04-9662-cd72ba1ed57a" acquired by "delete_volume" :: waited 0.021s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:43:42 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[321d55ba-123a-4ba4-a18f-80b9deb1c10d]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:43:42 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ef6bec0a-d34d-407a-aa66-ea00d4c320af tempest-VolumeQuotasAdminTestJSON-651676899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-efe21d65-4f71-4d04-9662-cd72ba1ed57a {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:42 devstack sudo[87438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-efe21d65-4f71-4d04-9662-cd72ba1ed57a
Feb 28 04:43:42 devstack sudo[87438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:42 devstack sudo[87434]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:42 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-600e26c4-403c-44b9-a2cf-8d9172e0f074 tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7.ef5f282e-1152-414c-8501-0a021b97a121" returned: 0 in 0.565s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:42 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-600e26c4-403c-44b9-a2cf-8d9172e0f074 tempest-GroupSnapshotsTest-1988525138 None] Lock "cinder-quobyte-ef5f282e-1152-414c-8501-0a021b97a121" released by "_delete_snapshot" :: held 2.629s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:43:42 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-600e26c4-403c-44b9-a2cf-8d9172e0f074 tempest-GroupSnapshotsTest-1988525138 None] Lock "cinder-quobyte-4921dbcc-1873-473d-a43c-275f3a708ca7" released by "delete_snapshot" :: held 2.643s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:43:42 devstack cinder-volume[84248]: WARNING cinder.quota [None req-600e26c4-403c-44b9-a2cf-8d9172e0f074 tempest-GroupSnapshotsTest-1988525138 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-223577202 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-223577202, it is now deprecated. Please use the default quota class for default quota.
Feb 28 04:43:42 devstack cinder-volume[84248]: WARNING cinder.quota [None req-600e26c4-403c-44b9-a2cf-8d9172e0f074 tempest-GroupSnapshotsTest-1988525138 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-223577202 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-223577202, it is now deprecated. Please use the default quota class for default quota.
Feb 28 04:43:42 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-600e26c4-403c-44b9-a2cf-8d9172e0f074 tempest-GroupSnapshotsTest-1988525138 None] Created reservations ['95ca155f-ed28-4742-9d68-a0784286b4b7', '43adc14f-f7b4-415b-bf9d-224e26de5ca1', '51cf83b3-0c85-40e1-bd86-9f85ebea54ae', 'bf75fdc5-5113-4aaf-9898-bf6816ca2166'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:43:42 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-600e26c4-403c-44b9-a2cf-8d9172e0f074 tempest-GroupSnapshotsTest-1988525138 None] group_snapshot 4655ce01-76d9-4c59-9ceb-7e0b29909337: deleted successfully
Feb 28 04:43:42 devstack sudo[87438]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:42 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ef6bec0a-d34d-407a-aa66-ea00d4c320af tempest-VolumeQuotasAdminTestJSON-651676899 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-efe21d65-4f71-4d04-9662-cd72ba1ed57a" returned: 0 in 0.538s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:42 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ef6bec0a-d34d-407a-aa66-ea00d4c320af tempest-VolumeQuotasAdminTestJSON-651676899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-efe21d65-4f71-4d04-9662-cd72ba1ed57a {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:42 devstack sudo[87444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-efe21d65-4f71-4d04-9662-cd72ba1ed57a
Feb 28 04:43:42 devstack sudo[87444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:43 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-3151dcfa-ffa6-4335-b970-635c4d13b737 tempest-GroupSnapshotsTest-1988525138 None] Acquiring lock "cinder-quobyte-4921dbcc-1873-473d-a43c-275f3a708ca7" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:43:43 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-3151dcfa-ffa6-4335-b970-635c4d13b737 tempest-GroupSnapshotsTest-1988525138 None] Lock "cinder-quobyte-4921dbcc-1873-473d-a43c-275f3a708ca7" acquired by "delete_volume" :: waited 0.012s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:43:43 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[067d6b51-c440-4845-bd46-4b7276e75ee4]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:43:43 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3151dcfa-ffa6-4335-b970-635c4d13b737 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:43 devstack sudo[87447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7
Feb 28 04:43:43 devstack sudo[87447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:43 devstack sudo[87444]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:43 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ef6bec0a-d34d-407a-aa66-ea00d4c320af tempest-VolumeQuotasAdminTestJSON-651676899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-efe21d65-4f71-4d04-9662-cd72ba1ed57a" returned: 0 in 0.539s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:43 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ef6bec0a-d34d-407a-aa66-ea00d4c320af tempest-VolumeQuotasAdminTestJSON-651676899 None] Lock "cinder-quobyte-efe21d65-4f71-4d04-9662-cd72ba1ed57a" released by "delete_volume" :: held 1.104s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:43:43 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-ef6bec0a-d34d-407a-aa66-ea00d4c320af tempest-VolumeQuotasAdminTestJSON-651676899 None] Created reservations ['b318b671-e61a-4bec-a6df-fa049ca1dafc', '37c087a7-1ae2-4c77-8254-1a73355ebc11', '94b14d89-a9f6-47cb-b510-7f8448eae6cb', '56af74af-ba6d-4aeb-b7d8-5eed317f04b3'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:43:43 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ef6bec0a-d34d-407a-aa66-ea00d4c320af tempest-VolumeQuotasAdminTestJSON-651676899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:43:43 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ef6bec0a-d34d-407a-aa66-ea00d4c320af tempest-VolumeQuotasAdminTestJSON-651676899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:43:43 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-ef6bec0a-d34d-407a-aa66-ea00d4c320af tempest-VolumeQuotasAdminTestJSON-651676899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:43:43 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-ef6bec0a-d34d-407a-aa66-ea00d4c320af tempest-VolumeQuotasAdminTestJSON-651676899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:43:43 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ef6bec0a-d34d-407a-aa66-ea00d4c320af tempest-VolumeQuotasAdminTestJSON-651676899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:43:43 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ef6bec0a-d34d-407a-aa66-ea00d4c320af tempest-VolumeQuotasAdminTestJSON-651676899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:43 devstack sudo[87450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:43:43 devstack sudo[87450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:43 devstack sudo[87447]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:43 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3151dcfa-ffa6-4335-b970-635c4d13b737 tempest-GroupSnapshotsTest-1988525138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7" returned: 0 in 0.499s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:43 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3151dcfa-ffa6-4335-b970-635c4d13b737 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:43 devstack sudo[87455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7
Feb 28 04:43:43 devstack sudo[87455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:43 devstack sudo[87450]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:43 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ef6bec0a-d34d-407a-aa66-ea00d4c320af tempest-VolumeQuotasAdminTestJSON-651676899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.409s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:43 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-ef6bec0a-d34d-407a-aa66-ea00d4c320af tempest-VolumeQuotasAdminTestJSON-651676899 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:43:43 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-ef6bec0a-d34d-407a-aa66-ea00d4c320af tempest-VolumeQuotasAdminTestJSON-651676899 None] Deleted volume successfully.
Feb 28 04:43:43 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ef6bec0a-d34d-407a-aa66-ea00d4c320af tempest-VolumeQuotasAdminTestJSON-651676899 None] Lock "cinder-efe21d65-4f71-4d04-9662-cd72ba1ed57a-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:43:44 devstack cinder-volume[84248]: INFO cinder.volume.manager [req-5cfdd8a6-4b1a-4fe2-9f07-5aa94011293c req-835c9e78-6ccf-46ac-8ff7-94c59aea768f tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Terminate volume connection completed successfully.
Feb 28 04:43:44 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-5cfdd8a6-4b1a-4fe2-9f07-5aa94011293c req-835c9e78-6ccf-46ac-8ff7-94c59aea768f tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Deleting attachment 98c87d3a-04cc-418d-9759-6467d53b7727. {{(pid=84248) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Feb 28 04:43:44 devstack sudo[87455]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3151dcfa-ffa6-4335-b970-635c4d13b737 tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4921dbcc-1873-473d-a43c-275f3a708ca7" returned: 0 in 0.416s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:44 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-3151dcfa-ffa6-4335-b970-635c4d13b737 tempest-GroupSnapshotsTest-1988525138 None] Lock "cinder-quobyte-4921dbcc-1873-473d-a43c-275f3a708ca7" released by "delete_volume" :: held 0.947s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:43:44 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-3151dcfa-ffa6-4335-b970-635c4d13b737 tempest-GroupSnapshotsTest-1988525138 None] Created reservations ['042c8215-556f-4831-ad24-a08c412ee5cd'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:43:44 devstack cinder-volume[84248]: WARNING cinder.quota [None req-3151dcfa-ffa6-4335-b970-635c4d13b737 tempest-GroupSnapshotsTest-1988525138 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-223577202 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-223577202, it is now deprecated. Please use the default quota class for default quota.
Feb 28 04:43:44 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-3151dcfa-ffa6-4335-b970-635c4d13b737 tempest-GroupSnapshotsTest-1988525138 None] Created reservations ['bedab8d6-b6cd-4dea-a9f8-42090ac50d22', '58b6ec6e-c94e-4b22-bdeb-c84bf3fd4fdd', '79bc65d3-d260-4303-bc09-17e4ddb975c1', 'dd259f8c-dad1-4007-95b2-7f9b077a3237'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:43:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3151dcfa-ffa6-4335-b970-635c4d13b737 tempest-GroupSnapshotsTest-1988525138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:43:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3151dcfa-ffa6-4335-b970-635c4d13b737 tempest-GroupSnapshotsTest-1988525138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:43:44 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-3151dcfa-ffa6-4335-b970-635c4d13b737 tempest-GroupSnapshotsTest-1988525138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:43:44 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-3151dcfa-ffa6-4335-b970-635c4d13b737 tempest-GroupSnapshotsTest-1988525138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:43:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3151dcfa-ffa6-4335-b970-635c4d13b737 tempest-GroupSnapshotsTest-1988525138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:43:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3151dcfa-ffa6-4335-b970-635c4d13b737 tempest-GroupSnapshotsTest-1988525138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:44 devstack sudo[87459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:43:44 devstack sudo[87459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:44 devstack cinder-volume[84248]: DEBUG cinder.coordination [req-5cfdd8a6-4b1a-4fe2-9f07-5aa94011293c req-4b725e96-393c-4ed4-a43d-798d295d284b tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Acquiring lock "cinder-f8e0796a-39b2-4dc1-b3c9-d019f0196d52-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:43:44 devstack cinder-volume[84248]: DEBUG cinder.coordination [req-5cfdd8a6-4b1a-4fe2-9f07-5aa94011293c req-4b725e96-393c-4ed4-a43d-798d295d284b tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Lock "cinder-f8e0796a-39b2-4dc1-b3c9-d019f0196d52-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:43:44 devstack sudo[87459]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3151dcfa-ffa6-4335-b970-635c4d13b737 tempest-GroupSnapshotsTest-1988525138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.502s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:44 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-3151dcfa-ffa6-4335-b970-635c4d13b737 tempest-GroupSnapshotsTest-1988525138 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:43:44 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-3151dcfa-ffa6-4335-b970-635c4d13b737 tempest-GroupSnapshotsTest-1988525138 None] Delete group completed successfully.
Feb 28 04:43:44 devstack cinder-volume[84248]: DEBUG cinder.coordination [req-5cfdd8a6-4b1a-4fe2-9f07-5aa94011293c req-4b725e96-393c-4ed4-a43d-798d295d284b tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Acquiring lock "cinder-quobyte-f8e0796a-39b2-4dc1-b3c9-d019f0196d52" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:43:44 devstack cinder-volume[84248]: DEBUG cinder.coordination [req-5cfdd8a6-4b1a-4fe2-9f07-5aa94011293c req-4b725e96-393c-4ed4-a43d-798d295d284b tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Lock "cinder-quobyte-f8e0796a-39b2-4dc1-b3c9-d019f0196d52" acquired by "delete_volume" :: waited 0.010s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:43:44 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a124c4-49b7-444f-b35d-3e0cf4454e61]: (4, 'raw') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:43:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-5cfdd8a6-4b1a-4fe2-9f07-5aa94011293c req-4b725e96-393c-4ed4-a43d-798d295d284b tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f8e0796a-39b2-4dc1-b3c9-d019f0196d52 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:44 devstack sudo[87463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f8e0796a-39b2-4dc1-b3c9-d019f0196d52
Feb 28 04:43:44 devstack sudo[87463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:45 devstack sudo[87463]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-5cfdd8a6-4b1a-4fe2-9f07-5aa94011293c req-4b725e96-393c-4ed4-a43d-798d295d284b tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f8e0796a-39b2-4dc1-b3c9-d019f0196d52" returned: 0 in 0.738s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-5cfdd8a6-4b1a-4fe2-9f07-5aa94011293c req-4b725e96-393c-4ed4-a43d-798d295d284b tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f8e0796a-39b2-4dc1-b3c9-d019f0196d52 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:45 devstack sudo[87467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f8e0796a-39b2-4dc1-b3c9-d019f0196d52
Feb 28 04:43:45 devstack sudo[87467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:46 devstack sudo[87467]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:46 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-5cfdd8a6-4b1a-4fe2-9f07-5aa94011293c req-4b725e96-393c-4ed4-a43d-798d295d284b tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f8e0796a-39b2-4dc1-b3c9-d019f0196d52" returned: 1 in 0.703s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:46 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-5cfdd8a6-4b1a-4fe2-9f07-5aa94011293c req-4b725e96-393c-4ed4-a43d-798d295d284b tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f8e0796a-39b2-4dc1-b3c9-d019f0196d52' failed. Not Retrying. {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 28 04:43:46 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-5cfdd8a6-4b1a-4fe2-9f07-5aa94011293c req-4b725e96-393c-4ed4-a43d-798d295d284b tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f8e0796a-39b2-4dc1-b3c9-d019f0196d52 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:46 devstack sudo[87472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f8e0796a-39b2-4dc1-b3c9-d019f0196d52
Feb 28 04:43:46 devstack sudo[87472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:46 devstack sudo[87472]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:46 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-5cfdd8a6-4b1a-4fe2-9f07-5aa94011293c req-4b725e96-393c-4ed4-a43d-798d295d284b tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f8e0796a-39b2-4dc1-b3c9-d019f0196d52" returned: 0 in 0.544s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:46 devstack cinder-volume[84248]: DEBUG cinder.coordination [req-5cfdd8a6-4b1a-4fe2-9f07-5aa94011293c req-4b725e96-393c-4ed4-a43d-798d295d284b tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Lock "cinder-quobyte-f8e0796a-39b2-4dc1-b3c9-d019f0196d52" released by "delete_volume" :: held 2.028s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:43:46 devstack cinder-volume[84248]: DEBUG cinder.quota [req-5cfdd8a6-4b1a-4fe2-9f07-5aa94011293c req-4b725e96-393c-4ed4-a43d-798d295d284b tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Created reservations ['00df3f01-be2f-454b-83e8-eda7d16d51d1', 'cc92c362-418e-407f-badd-76afb4f1a1dc', '794427cd-d573-454f-a81b-53986393eddf', '9b95d690-c2a0-402b-8bb0-115a80b8c230'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:43:46 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-5cfdd8a6-4b1a-4fe2-9f07-5aa94011293c req-4b725e96-393c-4ed4-a43d-798d295d284b tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:43:46 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-5cfdd8a6-4b1a-4fe2-9f07-5aa94011293c req-4b725e96-393c-4ed4-a43d-798d295d284b tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:43:46 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [req-5cfdd8a6-4b1a-4fe2-9f07-5aa94011293c req-4b725e96-393c-4ed4-a43d-798d295d284b tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:43:46 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [req-5cfdd8a6-4b1a-4fe2-9f07-5aa94011293c req-4b725e96-393c-4ed4-a43d-798d295d284b tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:43:46 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-5cfdd8a6-4b1a-4fe2-9f07-5aa94011293c req-4b725e96-393c-4ed4-a43d-798d295d284b tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:43:46 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-5cfdd8a6-4b1a-4fe2-9f07-5aa94011293c req-4b725e96-393c-4ed4-a43d-798d295d284b tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:46 devstack sudo[87475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:43:46 devstack sudo[87475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:47 devstack sudo[87475]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:47 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-5cfdd8a6-4b1a-4fe2-9f07-5aa94011293c req-4b725e96-393c-4ed4-a43d-798d295d284b tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.575s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:47 devstack cinder-volume[84248]: DEBUG cinder.manager [req-5cfdd8a6-4b1a-4fe2-9f07-5aa94011293c req-4b725e96-393c-4ed4-a43d-798d295d284b tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:43:47 devstack cinder-volume[84248]: INFO cinder.volume.manager [req-5cfdd8a6-4b1a-4fe2-9f07-5aa94011293c req-4b725e96-393c-4ed4-a43d-798d295d284b tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Deleted volume successfully.
Feb 28 04:43:47 devstack cinder-volume[84248]: DEBUG cinder.coordination [req-5cfdd8a6-4b1a-4fe2-9f07-5aa94011293c req-4b725e96-393c-4ed4-a43d-798d295d284b tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Lock "cinder-f8e0796a-39b2-4dc1-b3c9-d019f0196d52-delete_volume" released by "delete_volume" :: held 2.791s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:43:50 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-eae6e027-9382-4b14-a046-316a1493e013 tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:43:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-eae6e027-9382-4b14-a046-316a1493e013 tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Flow 'volume_create_manager' (13ff1262-9e08-4d37-9494-46826c1222ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:43:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-eae6e027-9382-4b14-a046-316a1493e013 tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a085e1-7b23-4a38-a9c5-9d882e421ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-eae6e027-9382-4b14-a046-316a1493e013 tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a085e1-7b23-4a38-a9c5-9d882e421ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:43:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1727172449',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92f4de4b-cd83-43b3-bb68-edd994cc4ca9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b26a8f0a7f1944aa9cfccf991df99833',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:43:51Z,use_quota=True,user_id='771ff9201b5c4fed9ee89da2a38f5be4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-eae6e027-9382-4b14-a046-316a1493e013 tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b3ec965-5580-4e2c-a9fc-68ad5938442e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-eae6e027-9382-4b14-a046-316a1493e013 tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b3ec965-5580-4e2c-a9fc-68ad5938442e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-eae6e027-9382-4b14-a046-316a1493e013 tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c635f5d0-63fb-461c-9ef9-afc52463118e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-eae6e027-9382-4b14-a046-316a1493e013 tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c635f5d0-63fb-461c-9ef9-afc52463118e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92f4de4b-cd83-43b3-bb68-edd994cc4ca9', 'volume_name': 'volume-92f4de4b-cd83-43b3-bb68-edd994cc4ca9', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-eae6e027-9382-4b14-a046-316a1493e013 tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bc4a88a-ba54-42d8-8f35-e3bed0c2ce98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-eae6e027-9382-4b14-a046-316a1493e013 tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bc4a88a-ba54-42d8-8f35-e3bed0c2ce98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-eae6e027-9382-4b14-a046-316a1493e013 tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d21df046-a539-46d4-8bf2-a17dc2567835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:50 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-eae6e027-9382-4b14-a046-316a1493e013 tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Volume 92f4de4b-cd83-43b3-bb68-edd994cc4ca9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92f4de4b-cd83-43b3-bb68-edd994cc4ca9', 'volume_size': 1}
Feb 28 04:43:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-eae6e027-9382-4b14-a046-316a1493e013 tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:43:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-eae6e027-9382-4b14-a046-316a1493e013 tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:43:50 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-eae6e027-9382-4b14-a046-316a1493e013 tempest-VolumeQuotasNegativeTestJSON-1964593738 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:43:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1727172449',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92f4de4b-cd83-43b3-bb68-edd994cc4ca9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b26a8f0a7f1944aa9cfccf991df99833',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:43:51Z,use_quota=True,user_id='771ff9201b5c4fed9ee89da2a38f5be4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:43:50 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-eae6e027-9382-4b14-a046-316a1493e013 tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Creating volume 92f4de4b-cd83-43b3-bb68-edd994cc4ca9 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:43:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-eae6e027-9382-4b14-a046-316a1493e013 tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:43:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-eae6e027-9382-4b14-a046-316a1493e013 tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:43:50 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-eae6e027-9382-4b14-a046-316a1493e013 tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:43:50 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-eae6e027-9382-4b14-a046-316a1493e013 tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:43:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-eae6e027-9382-4b14-a046-316a1493e013 tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:43:50 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-eae6e027-9382-4b14-a046-316a1493e013 tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:43:50 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-eae6e027-9382-4b14-a046-316a1493e013 tempest-VolumeQuotasNegativeTestJSON-1964593738 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:43:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-eae6e027-9382-4b14-a046-316a1493e013 tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-92f4de4b-cd83-43b3-bb68-edd994cc4ca9 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:50 devstack sudo[87506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-92f4de4b-cd83-43b3-bb68-edd994cc4ca9 1073741824
Feb 28 04:43:50 devstack sudo[87506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:51 devstack sudo[87506]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-eae6e027-9382-4b14-a046-316a1493e013 tempest-VolumeQuotasNegativeTestJSON-1964593738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-92f4de4b-cd83-43b3-bb68-edd994cc4ca9 1073741824" returned: 0 in 0.780s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-eae6e027-9382-4b14-a046-316a1493e013 tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-92f4de4b-cd83-43b3-bb68-edd994cc4ca9 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:51 devstack sudo[87514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-92f4de4b-cd83-43b3-bb68-edd994cc4ca9
Feb 28 04:43:51 devstack sudo[87514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:52 devstack sudo[87514]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-eae6e027-9382-4b14-a046-316a1493e013 tempest-VolumeQuotasNegativeTestJSON-1964593738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-92f4de4b-cd83-43b3-bb68-edd994cc4ca9" returned: 0 in 0.485s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:52 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-eae6e027-9382-4b14-a046-316a1493e013 tempest-VolumeQuotasNegativeTestJSON-1964593738 None] <== create_volume: return (1314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:43:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-eae6e027-9382-4b14-a046-316a1493e013 tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.315s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:43:52 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-eae6e027-9382-4b14-a046-316a1493e013 tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d21df046-a539-46d4-8bf2-a17dc2567835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92f4de4b-cd83-43b3-bb68-edd994cc4ca9', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:52 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-eae6e027-9382-4b14-a046-316a1493e013 tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1da68bf-e0d8-41d5-921f-7ce39cf855c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:52 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-eae6e027-9382-4b14-a046-316a1493e013 tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Volume volume-92f4de4b-cd83-43b3-bb68-edd994cc4ca9 (92f4de4b-cd83-43b3-bb68-edd994cc4ca9): created successfully
Feb 28 04:43:52 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-eae6e027-9382-4b14-a046-316a1493e013 tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1da68bf-e0d8-41d5-921f-7ce39cf855c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:52 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-eae6e027-9382-4b14-a046-316a1493e013 tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Flow 'volume_create_manager' (13ff1262-9e08-4d37-9494-46826c1222ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:43:52 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-eae6e027-9382-4b14-a046-316a1493e013 tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Created volume successfully.
Feb 28 04:43:53 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-cadf05ed-b06b-4ab3-853f-243b03d3cd55 tempest-VolumesServicesTestJSON-274728069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:43:53 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-cadf05ed-b06b-4ab3-853f-243b03d3cd55 tempest-VolumesServicesTestJSON-274728069 None] Flow 'volume_create_manager' (1b28f362-f183-47b0-b110-f696553e8c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:43:53 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-cadf05ed-b06b-4ab3-853f-243b03d3cd55 tempest-VolumesServicesTestJSON-274728069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d4f1efa-9392-4075-b7d7-add6ebb6df3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:53 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-cadf05ed-b06b-4ab3-853f-243b03d3cd55 tempest-VolumesServicesTestJSON-274728069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d4f1efa-9392-4075-b7d7-add6ebb6df3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:43:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-241550350',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47725e29-eaf8-4e00-bfb1-b03467636122,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471fa459f43648f48e46da394e87269e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:43:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:43:53Z,use_quota=True,user_id='43ad58a52e3740d8ab369e0588f9a4e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:53 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-cadf05ed-b06b-4ab3-853f-243b03d3cd55 tempest-VolumesServicesTestJSON-274728069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb57c354-b693-48e6-9e1f-14b660b60191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:53 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-cadf05ed-b06b-4ab3-853f-243b03d3cd55 tempest-VolumesServicesTestJSON-274728069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb57c354-b693-48e6-9e1f-14b660b60191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:53 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-cadf05ed-b06b-4ab3-853f-243b03d3cd55 tempest-VolumesServicesTestJSON-274728069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1ff33d7-82c5-4a7e-9297-68926305bdd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:53 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-cadf05ed-b06b-4ab3-853f-243b03d3cd55 tempest-VolumesServicesTestJSON-274728069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1ff33d7-82c5-4a7e-9297-68926305bdd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47725e29-eaf8-4e00-bfb1-b03467636122', 'volume_name': 'volume-47725e29-eaf8-4e00-bfb1-b03467636122', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:53 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-cadf05ed-b06b-4ab3-853f-243b03d3cd55 tempest-VolumesServicesTestJSON-274728069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76eff33a-2ffa-4aaa-a3b9-8800783df7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:53 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-cadf05ed-b06b-4ab3-853f-243b03d3cd55 tempest-VolumesServicesTestJSON-274728069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76eff33a-2ffa-4aaa-a3b9-8800783df7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:53 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-cadf05ed-b06b-4ab3-853f-243b03d3cd55 tempest-VolumesServicesTestJSON-274728069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aec65ead-ca5e-4fba-806f-e6a419788bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:53 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-cadf05ed-b06b-4ab3-853f-243b03d3cd55 tempest-VolumesServicesTestJSON-274728069 None] Volume 47725e29-eaf8-4e00-bfb1-b03467636122: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47725e29-eaf8-4e00-bfb1-b03467636122', 'volume_size': 1}
Feb 28 04:43:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-cadf05ed-b06b-4ab3-853f-243b03d3cd55 tempest-VolumesServicesTestJSON-274728069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:43:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-cadf05ed-b06b-4ab3-853f-243b03d3cd55 tempest-VolumesServicesTestJSON-274728069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:43:53 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-cadf05ed-b06b-4ab3-853f-243b03d3cd55 tempest-VolumesServicesTestJSON-274728069 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:43:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-241550350',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47725e29-eaf8-4e00-bfb1-b03467636122,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471fa459f43648f48e46da394e87269e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:43:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:43:53Z,use_quota=True,user_id='43ad58a52e3740d8ab369e0588f9a4e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:43:53 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-cadf05ed-b06b-4ab3-853f-243b03d3cd55 tempest-VolumesServicesTestJSON-274728069 None] Creating volume 47725e29-eaf8-4e00-bfb1-b03467636122 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:43:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-cadf05ed-b06b-4ab3-853f-243b03d3cd55 tempest-VolumesServicesTestJSON-274728069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:43:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-cadf05ed-b06b-4ab3-853f-243b03d3cd55 tempest-VolumesServicesTestJSON-274728069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:43:53 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-cadf05ed-b06b-4ab3-853f-243b03d3cd55 tempest-VolumesServicesTestJSON-274728069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:43:53 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-cadf05ed-b06b-4ab3-853f-243b03d3cd55 tempest-VolumesServicesTestJSON-274728069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:43:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-cadf05ed-b06b-4ab3-853f-243b03d3cd55 tempest-VolumesServicesTestJSON-274728069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:43:53 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-cadf05ed-b06b-4ab3-853f-243b03d3cd55 tempest-VolumesServicesTestJSON-274728069 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:43:53 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-cadf05ed-b06b-4ab3-853f-243b03d3cd55 tempest-VolumesServicesTestJSON-274728069 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:43:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-cadf05ed-b06b-4ab3-853f-243b03d3cd55 tempest-VolumesServicesTestJSON-274728069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-47725e29-eaf8-4e00-bfb1-b03467636122 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:53 devstack sudo[87517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-47725e29-eaf8-4e00-bfb1-b03467636122 1073741824
Feb 28 04:43:53 devstack sudo[87517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:53 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d07dd32c-5721-40e0-a06c-2df26fc754ed tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Acquiring lock "cinder-92f4de4b-cd83-43b3-bb68-edd994cc4ca9-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:43:53 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d07dd32c-5721-40e0-a06c-2df26fc754ed tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Lock "cinder-92f4de4b-cd83-43b3-bb68-edd994cc4ca9-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:43:53 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d07dd32c-5721-40e0-a06c-2df26fc754ed tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Acquiring lock "cinder-quobyte-92f4de4b-cd83-43b3-bb68-edd994cc4ca9" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:43:53 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d07dd32c-5721-40e0-a06c-2df26fc754ed tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Lock "cinder-quobyte-92f4de4b-cd83-43b3-bb68-edd994cc4ca9" acquired by "delete_volume" :: waited 0.010s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:43:53 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d4dea8-3a36-4470-bd8b-f46d05273cf3]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:43:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d07dd32c-5721-40e0-a06c-2df26fc754ed tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-92f4de4b-cd83-43b3-bb68-edd994cc4ca9 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:53 devstack sudo[87519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-92f4de4b-cd83-43b3-bb68-edd994cc4ca9
Feb 28 04:43:53 devstack sudo[87519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:53 devstack sudo[87517]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-cadf05ed-b06b-4ab3-853f-243b03d3cd55 tempest-VolumesServicesTestJSON-274728069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-47725e29-eaf8-4e00-bfb1-b03467636122 1073741824" returned: 0 in 0.568s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-cadf05ed-b06b-4ab3-853f-243b03d3cd55 tempest-VolumesServicesTestJSON-274728069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-47725e29-eaf8-4e00-bfb1-b03467636122 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:53 devstack sudo[87524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-47725e29-eaf8-4e00-bfb1-b03467636122
Feb 28 04:43:53 devstack sudo[87524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:54 devstack sudo[87519]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d07dd32c-5721-40e0-a06c-2df26fc754ed tempest-VolumeQuotasNegativeTestJSON-1964593738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-92f4de4b-cd83-43b3-bb68-edd994cc4ca9" returned: 0 in 0.582s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d07dd32c-5721-40e0-a06c-2df26fc754ed tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-92f4de4b-cd83-43b3-bb68-edd994cc4ca9 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:54 devstack sudo[87529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-92f4de4b-cd83-43b3-bb68-edd994cc4ca9
Feb 28 04:43:54 devstack sudo[87529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:54 devstack sudo[87524]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-cadf05ed-b06b-4ab3-853f-243b03d3cd55 tempest-VolumesServicesTestJSON-274728069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-47725e29-eaf8-4e00-bfb1-b03467636122" returned: 0 in 0.489s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:54 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-cadf05ed-b06b-4ab3-853f-243b03d3cd55 tempest-VolumesServicesTestJSON-274728069 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:43:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-cadf05ed-b06b-4ab3-853f-243b03d3cd55 tempest-VolumesServicesTestJSON-274728069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:43:54 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-cadf05ed-b06b-4ab3-853f-243b03d3cd55 tempest-VolumesServicesTestJSON-274728069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aec65ead-ca5e-4fba-806f-e6a419788bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47725e29-eaf8-4e00-bfb1-b03467636122', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:54 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-cadf05ed-b06b-4ab3-853f-243b03d3cd55 tempest-VolumesServicesTestJSON-274728069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2064dcc3-abba-452a-bd55-1bdbac679b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:43:54 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-cadf05ed-b06b-4ab3-853f-243b03d3cd55 tempest-VolumesServicesTestJSON-274728069 None] Volume volume-47725e29-eaf8-4e00-bfb1-b03467636122 (47725e29-eaf8-4e00-bfb1-b03467636122): created successfully
Feb 28 04:43:54 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-cadf05ed-b06b-4ab3-853f-243b03d3cd55 tempest-VolumesServicesTestJSON-274728069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2064dcc3-abba-452a-bd55-1bdbac679b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:43:54 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-cadf05ed-b06b-4ab3-853f-243b03d3cd55 tempest-VolumesServicesTestJSON-274728069 None] Flow 'volume_create_manager' (1b28f362-f183-47b0-b110-f696553e8c40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:43:54 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-cadf05ed-b06b-4ab3-853f-243b03d3cd55 tempest-VolumesServicesTestJSON-274728069 None] Created volume successfully.
Feb 28 04:43:54 devstack sudo[87529]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d07dd32c-5721-40e0-a06c-2df26fc754ed tempest-VolumeQuotasNegativeTestJSON-1964593738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-92f4de4b-cd83-43b3-bb68-edd994cc4ca9" returned: 0 in 0.523s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:54 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d07dd32c-5721-40e0-a06c-2df26fc754ed tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Lock "cinder-quobyte-92f4de4b-cd83-43b3-bb68-edd994cc4ca9" released by "delete_volume" :: held 1.129s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:43:54 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-d07dd32c-5721-40e0-a06c-2df26fc754ed tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Created reservations ['d5cc3114-b0b8-47d1-8788-e12dd4057d55', '5d63fdd2-bb13-4786-b69a-ad1f4c9ddb43', '45cbebae-f9c8-4994-9c64-fc329189509b', 'bc915bc6-63f2-459b-9582-a528ed6afed7'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:43:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d07dd32c-5721-40e0-a06c-2df26fc754ed tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:43:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d07dd32c-5721-40e0-a06c-2df26fc754ed tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:43:54 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-d07dd32c-5721-40e0-a06c-2df26fc754ed tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:43:54 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-d07dd32c-5721-40e0-a06c-2df26fc754ed tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:43:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d07dd32c-5721-40e0-a06c-2df26fc754ed tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:43:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d07dd32c-5721-40e0-a06c-2df26fc754ed tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:54 devstack sudo[87533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:43:54 devstack sudo[87533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:55 devstack sudo[87533]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d07dd32c-5721-40e0-a06c-2df26fc754ed tempest-VolumeQuotasNegativeTestJSON-1964593738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.488s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:55 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-d07dd32c-5721-40e0-a06c-2df26fc754ed tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:43:55 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-d07dd32c-5721-40e0-a06c-2df26fc754ed tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Deleted volume successfully.
Feb 28 04:43:55 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d07dd32c-5721-40e0-a06c-2df26fc754ed tempest-VolumeQuotasNegativeTestJSON-1964593738 None] Lock "cinder-92f4de4b-cd83-43b3-bb68-edd994cc4ca9-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:43:55 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-630cfa1b-b27a-4fef-808e-0c32b93d9dbb tempest-VolumesServicesTestJSON-274728069 None] Acquiring lock "cinder-47725e29-eaf8-4e00-bfb1-b03467636122-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:43:55 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-630cfa1b-b27a-4fef-808e-0c32b93d9dbb tempest-VolumesServicesTestJSON-274728069 None] Lock "cinder-47725e29-eaf8-4e00-bfb1-b03467636122-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:43:55 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-630cfa1b-b27a-4fef-808e-0c32b93d9dbb tempest-VolumesServicesTestJSON-274728069 None] Acquiring lock "cinder-quobyte-47725e29-eaf8-4e00-bfb1-b03467636122" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:43:55 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-630cfa1b-b27a-4fef-808e-0c32b93d9dbb tempest-VolumesServicesTestJSON-274728069 None] Lock "cinder-quobyte-47725e29-eaf8-4e00-bfb1-b03467636122" acquired by "delete_volume" :: waited 0.007s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:43:55 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c81d839-2cae-407a-8f55-e307a23d6123]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:43:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-630cfa1b-b27a-4fef-808e-0c32b93d9dbb tempest-VolumesServicesTestJSON-274728069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-47725e29-eaf8-4e00-bfb1-b03467636122 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:55 devstack sudo[87536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-47725e29-eaf8-4e00-bfb1-b03467636122
Feb 28 04:43:55 devstack sudo[87536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:56 devstack sudo[87536]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:56 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-630cfa1b-b27a-4fef-808e-0c32b93d9dbb tempest-VolumesServicesTestJSON-274728069 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-47725e29-eaf8-4e00-bfb1-b03467636122" returned: 0 in 0.693s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:56 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-630cfa1b-b27a-4fef-808e-0c32b93d9dbb tempest-VolumesServicesTestJSON-274728069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-47725e29-eaf8-4e00-bfb1-b03467636122 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:56 devstack sudo[87564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-47725e29-eaf8-4e00-bfb1-b03467636122
Feb 28 04:43:56 devstack sudo[87564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:56 devstack sudo[87564]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:56 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-630cfa1b-b27a-4fef-808e-0c32b93d9dbb tempest-VolumesServicesTestJSON-274728069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-47725e29-eaf8-4e00-bfb1-b03467636122" returned: 0 in 0.554s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:56 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-630cfa1b-b27a-4fef-808e-0c32b93d9dbb tempest-VolumesServicesTestJSON-274728069 None] Lock "cinder-quobyte-47725e29-eaf8-4e00-bfb1-b03467636122" released by "delete_volume" :: held 1.274s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:43:56 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-630cfa1b-b27a-4fef-808e-0c32b93d9dbb tempest-VolumesServicesTestJSON-274728069 None] Created reservations ['35b61785-14f5-47b0-a142-67443d04de1c', 'cd4deed6-3301-4f84-8791-16ab986f8c54', '8eda168d-fc14-44cf-b7f0-367ee37b8319', 'd25f4ad0-4ed2-4eca-9c77-4012d3fcafc1'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:43:56 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-630cfa1b-b27a-4fef-808e-0c32b93d9dbb tempest-VolumesServicesTestJSON-274728069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:43:56 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-630cfa1b-b27a-4fef-808e-0c32b93d9dbb tempest-VolumesServicesTestJSON-274728069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:43:56 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-630cfa1b-b27a-4fef-808e-0c32b93d9dbb tempest-VolumesServicesTestJSON-274728069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:43:56 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-630cfa1b-b27a-4fef-808e-0c32b93d9dbb tempest-VolumesServicesTestJSON-274728069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:43:56 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-630cfa1b-b27a-4fef-808e-0c32b93d9dbb tempest-VolumesServicesTestJSON-274728069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:43:56 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-630cfa1b-b27a-4fef-808e-0c32b93d9dbb tempest-VolumesServicesTestJSON-274728069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:56 devstack sudo[87569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:43:56 devstack sudo[87569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:57 devstack sudo[87569]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:57 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-630cfa1b-b27a-4fef-808e-0c32b93d9dbb tempest-VolumesServicesTestJSON-274728069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.553s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:57 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-630cfa1b-b27a-4fef-808e-0c32b93d9dbb tempest-VolumesServicesTestJSON-274728069 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:43:57 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-630cfa1b-b27a-4fef-808e-0c32b93d9dbb tempest-VolumesServicesTestJSON-274728069 None] Deleted volume successfully.
Feb 28 04:43:57 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-630cfa1b-b27a-4fef-808e-0c32b93d9dbb tempest-VolumesServicesTestJSON-274728069 None] Lock "cinder-47725e29-eaf8-4e00-bfb1-b03467636122-delete_volume" released by "delete_volume" :: held 1.995s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:43:58 devstack cinder-volume[84248]: INFO cinder.volume.manager [req-5b527c3c-4dbd-40f5-b3d6-c0b88bf9937a req-4ced4f5b-b352-4d5f-86d7-b625ce59d9e3 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Terminate volume connection completed successfully.
Feb 28 04:43:58 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-5b527c3c-4dbd-40f5-b3d6-c0b88bf9937a req-4ced4f5b-b352-4d5f-86d7-b625ce59d9e3 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Deleting attachment d4384b28-dd23-44d9-be7a-bed5d5cc16fe. {{(pid=84248) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Feb 28 04:43:59 devstack cinder-volume[84248]: DEBUG cinder.coordination [req-5b527c3c-4dbd-40f5-b3d6-c0b88bf9937a req-73c3fdf2-15be-4c90-9117-68d8974d3aa1 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Acquiring lock "cinder-bf5fc4a3-ac9c-4cf6-949b-4e1fd2a8e7fa-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:43:59 devstack cinder-volume[84248]: DEBUG cinder.coordination [req-5b527c3c-4dbd-40f5-b3d6-c0b88bf9937a req-73c3fdf2-15be-4c90-9117-68d8974d3aa1 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Lock "cinder-bf5fc4a3-ac9c-4cf6-949b-4e1fd2a8e7fa-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:43:59 devstack cinder-volume[84248]: DEBUG cinder.coordination [req-5b527c3c-4dbd-40f5-b3d6-c0b88bf9937a req-73c3fdf2-15be-4c90-9117-68d8974d3aa1 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Acquiring lock "cinder-quobyte-bf5fc4a3-ac9c-4cf6-949b-4e1fd2a8e7fa" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:43:59 devstack cinder-volume[84248]: DEBUG cinder.coordination [req-5b527c3c-4dbd-40f5-b3d6-c0b88bf9937a req-73c3fdf2-15be-4c90-9117-68d8974d3aa1 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Lock "cinder-quobyte-bf5fc4a3-ac9c-4cf6-949b-4e1fd2a8e7fa" acquired by "delete_volume" :: waited 0.008s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:43:59 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d01a66-668a-4978-83ba-286516fe9c74]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:43:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-5b527c3c-4dbd-40f5-b3d6-c0b88bf9937a req-73c3fdf2-15be-4c90-9117-68d8974d3aa1 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bf5fc4a3-ac9c-4cf6-949b-4e1fd2a8e7fa {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:59 devstack sudo[87573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bf5fc4a3-ac9c-4cf6-949b-4e1fd2a8e7fa
Feb 28 04:43:59 devstack sudo[87573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:43:59 devstack sudo[87573]: pam_unix(sudo:session): session closed for user root
Feb 28 04:43:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-5b527c3c-4dbd-40f5-b3d6-c0b88bf9937a req-73c3fdf2-15be-4c90-9117-68d8974d3aa1 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bf5fc4a3-ac9c-4cf6-949b-4e1fd2a8e7fa" returned: 0 in 0.683s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:43:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-5b527c3c-4dbd-40f5-b3d6-c0b88bf9937a req-73c3fdf2-15be-4c90-9117-68d8974d3aa1 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bf5fc4a3-ac9c-4cf6-949b-4e1fd2a8e7fa {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:43:59 devstack sudo[87579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bf5fc4a3-ac9c-4cf6-949b-4e1fd2a8e7fa
Feb 28 04:43:59 devstack sudo[87579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:00 devstack sudo[87579]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-5b527c3c-4dbd-40f5-b3d6-c0b88bf9937a req-73c3fdf2-15be-4c90-9117-68d8974d3aa1 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bf5fc4a3-ac9c-4cf6-949b-4e1fd2a8e7fa" returned: 0 in 0.574s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:00 devstack cinder-volume[84248]: DEBUG cinder.coordination [req-5b527c3c-4dbd-40f5-b3d6-c0b88bf9937a req-73c3fdf2-15be-4c90-9117-68d8974d3aa1 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Lock "cinder-quobyte-bf5fc4a3-ac9c-4cf6-949b-4e1fd2a8e7fa" released by "delete_volume" :: held 1.297s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:44:00 devstack cinder-volume[84248]: DEBUG cinder.quota [req-5b527c3c-4dbd-40f5-b3d6-c0b88bf9937a req-73c3fdf2-15be-4c90-9117-68d8974d3aa1 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Created reservations ['450a2223-36ae-4268-ba80-6362a5c10c8d', 'bc78d252-9bee-4ffc-9db5-164a49917223', '3c0f8857-6256-40f3-932c-66ee1ef6d5f4', '562cf672-f04d-4798-96f6-5c0b1379e516'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:44:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-5b527c3c-4dbd-40f5-b3d6-c0b88bf9937a req-73c3fdf2-15be-4c90-9117-68d8974d3aa1 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:44:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-5b527c3c-4dbd-40f5-b3d6-c0b88bf9937a req-73c3fdf2-15be-4c90-9117-68d8974d3aa1 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:44:00 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [req-5b527c3c-4dbd-40f5-b3d6-c0b88bf9937a req-73c3fdf2-15be-4c90-9117-68d8974d3aa1 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:44:00 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [req-5b527c3c-4dbd-40f5-b3d6-c0b88bf9937a req-73c3fdf2-15be-4c90-9117-68d8974d3aa1 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:44:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-5b527c3c-4dbd-40f5-b3d6-c0b88bf9937a req-73c3fdf2-15be-4c90-9117-68d8974d3aa1 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:44:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-5b527c3c-4dbd-40f5-b3d6-c0b88bf9937a req-73c3fdf2-15be-4c90-9117-68d8974d3aa1 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:00 devstack sudo[87582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:44:00 devstack sudo[87582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:01 devstack sudo[87582]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-5b527c3c-4dbd-40f5-b3d6-c0b88bf9937a req-73c3fdf2-15be-4c90-9117-68d8974d3aa1 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.575s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:01 devstack cinder-volume[84248]: DEBUG cinder.manager [req-5b527c3c-4dbd-40f5-b3d6-c0b88bf9937a req-73c3fdf2-15be-4c90-9117-68d8974d3aa1 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:44:01 devstack cinder-volume[84248]: INFO cinder.volume.manager [req-5b527c3c-4dbd-40f5-b3d6-c0b88bf9937a req-73c3fdf2-15be-4c90-9117-68d8974d3aa1 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Deleted volume successfully.
Feb 28 04:44:01 devstack cinder-volume[84248]: DEBUG cinder.coordination [req-5b527c3c-4dbd-40f5-b3d6-c0b88bf9937a req-73c3fdf2-15be-4c90-9117-68d8974d3aa1 tempest-ServerBootFromVolumeStableRescueTest-1864572374 None] Lock "cinder-bf5fc4a3-ac9c-4cf6-949b-4e1fd2a8e7fa-delete_volume" released by "delete_volume" :: held 2.107s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:44:02 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-2540d2b8-2c40-431b-83fd-301914c83864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:44:02 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-2540d2b8-2c40-431b-83fd-301914c83864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Flow 'volume_create_manager' (3e036e37-4fed-44d1-8376-5267f69bf340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:44:02 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-2540d2b8-2c40-431b-83fd-301914c83864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90bececd-0c91-4043-93ee-92c243a09c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:02 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-2540d2b8-2c40-431b-83fd-301914c83864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90bececd-0c91-4043-93ee-92c243a09c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:44:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2139187452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edc48f38-4638-4efd-abc2-98e0be3c2a4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb8b310e3c3e4b939805a6cf5690c966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:44:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:44:02Z,use_quota=True,user_id='0a82137069a14e479f0394677088f102',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:02 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-2540d2b8-2c40-431b-83fd-301914c83864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54d5373e-cc98-4f14-9095-2324d30e85d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:02 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-2540d2b8-2c40-431b-83fd-301914c83864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54d5373e-cc98-4f14-9095-2324d30e85d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:02 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-2540d2b8-2c40-431b-83fd-301914c83864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bdfbd6b-afd5-47bb-b49d-c5eadf7a7513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:02 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-2540d2b8-2c40-431b-83fd-301914c83864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bdfbd6b-afd5-47bb-b49d-c5eadf7a7513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edc48f38-4638-4efd-abc2-98e0be3c2a4b', 'volume_name': 'volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:02 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-2540d2b8-2c40-431b-83fd-301914c83864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d4fa998-9bf7-4f29-a868-5baf2626abbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:02 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-2540d2b8-2c40-431b-83fd-301914c83864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d4fa998-9bf7-4f29-a868-5baf2626abbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:02 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-2540d2b8-2c40-431b-83fd-301914c83864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7b05d82-4873-4e74-8fda-0cbaf01c7110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:02 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-2540d2b8-2c40-431b-83fd-301914c83864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Volume edc48f38-4638-4efd-abc2-98e0be3c2a4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b', 'volume_size': 1}
Feb 28 04:44:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-2540d2b8-2c40-431b-83fd-301914c83864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:44:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-2540d2b8-2c40-431b-83fd-301914c83864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:44:02 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-2540d2b8-2c40-431b-83fd-301914c83864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:44:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2139187452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edc48f38-4638-4efd-abc2-98e0be3c2a4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb8b310e3c3e4b939805a6cf5690c966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:44:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:44:02Z,use_quota=True,user_id='0a82137069a14e479f0394677088f102',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:44:02 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-2540d2b8-2c40-431b-83fd-301914c83864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Creating volume edc48f38-4638-4efd-abc2-98e0be3c2a4b {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:44:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-2540d2b8-2c40-431b-83fd-301914c83864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:44:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-2540d2b8-2c40-431b-83fd-301914c83864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:44:02 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-2540d2b8-2c40-431b-83fd-301914c83864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:44:02 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-2540d2b8-2c40-431b-83fd-301914c83864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:44:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-2540d2b8-2c40-431b-83fd-301914c83864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:44:02 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-2540d2b8-2c40-431b-83fd-301914c83864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:44:02 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-2540d2b8-2c40-431b-83fd-301914c83864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:44:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-2540d2b8-2c40-431b-83fd-301914c83864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:02 devstack sudo[87585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b 1073741824
Feb 28 04:44:02 devstack sudo[87585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:03 devstack sudo[87585]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-2540d2b8-2c40-431b-83fd-301914c83864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b 1073741824" returned: 0 in 0.605s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-2540d2b8-2c40-431b-83fd-301914c83864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:03 devstack sudo[87590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b
Feb 28 04:44:03 devstack sudo[87590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:03 devstack sudo[87590]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-2540d2b8-2c40-431b-83fd-301914c83864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b" returned: 0 in 0.530s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:03 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-2540d2b8-2c40-431b-83fd-301914c83864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:44:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-2540d2b8-2c40-431b-83fd-301914c83864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:44:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-2540d2b8-2c40-431b-83fd-301914c83864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7b05d82-4873-4e74-8fda-0cbaf01c7110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-2540d2b8-2c40-431b-83fd-301914c83864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7796941b-06d4-44ac-9a90-624e91495d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:03 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-2540d2b8-2c40-431b-83fd-301914c83864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Volume volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b (edc48f38-4638-4efd-abc2-98e0be3c2a4b): created successfully
Feb 28 04:44:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-2540d2b8-2c40-431b-83fd-301914c83864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7796941b-06d4-44ac-9a90-624e91495d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-2540d2b8-2c40-431b-83fd-301914c83864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Flow 'volume_create_manager' (3e036e37-4fed-44d1-8376-5267f69bf340) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:44:03 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-2540d2b8-2c40-431b-83fd-301914c83864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Created volume successfully.
Feb 28 04:44:04 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-48dfa51e-a6a3-456f-b7cd-31508e47f1e9 tempest-VolumesListAdminTestJSON-622303885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:44:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-48dfa51e-a6a3-456f-b7cd-31508e47f1e9 tempest-VolumesListAdminTestJSON-622303885 None] Flow 'volume_create_manager' (94fddfde-1363-4827-bf90-e1a975c83b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:44:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-48dfa51e-a6a3-456f-b7cd-31508e47f1e9 tempest-VolumesListAdminTestJSON-622303885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb96f16-2207-4c7d-b5d9-8e7ea504e0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-48dfa51e-a6a3-456f-b7cd-31508e47f1e9 tempest-VolumesListAdminTestJSON-622303885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb96f16-2207-4c7d-b5d9-8e7ea504e0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1090626836',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c61b70e-3d0c-4cd3-9b09-2e5889a634aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eee6a8f33c14b518a8141de3d440d4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:44:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:44:04Z,use_quota=True,user_id='837c22e8c8c04e58b89e4ad2c99d3ccc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-48dfa51e-a6a3-456f-b7cd-31508e47f1e9 tempest-VolumesListAdminTestJSON-622303885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00991e32-f19d-4de3-af38-ce64531fec58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-48dfa51e-a6a3-456f-b7cd-31508e47f1e9 tempest-VolumesListAdminTestJSON-622303885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00991e32-f19d-4de3-af38-ce64531fec58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-48dfa51e-a6a3-456f-b7cd-31508e47f1e9 tempest-VolumesListAdminTestJSON-622303885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7598315-2ff6-463d-93fe-644cfb867df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-48dfa51e-a6a3-456f-b7cd-31508e47f1e9 tempest-VolumesListAdminTestJSON-622303885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7598315-2ff6-463d-93fe-644cfb867df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c61b70e-3d0c-4cd3-9b09-2e5889a634aa', 'volume_name': 'volume-0c61b70e-3d0c-4cd3-9b09-2e5889a634aa', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-48dfa51e-a6a3-456f-b7cd-31508e47f1e9 tempest-VolumesListAdminTestJSON-622303885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8c7d021-e9cd-419d-9575-64b84c499bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-48dfa51e-a6a3-456f-b7cd-31508e47f1e9 tempest-VolumesListAdminTestJSON-622303885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8c7d021-e9cd-419d-9575-64b84c499bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-48dfa51e-a6a3-456f-b7cd-31508e47f1e9 tempest-VolumesListAdminTestJSON-622303885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe134637-5460-45fd-b1c4-1f566eda7bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:04 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-48dfa51e-a6a3-456f-b7cd-31508e47f1e9 tempest-VolumesListAdminTestJSON-622303885 None] Volume 0c61b70e-3d0c-4cd3-9b09-2e5889a634aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c61b70e-3d0c-4cd3-9b09-2e5889a634aa', 'volume_size': 1}
Feb 28 04:44:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-48dfa51e-a6a3-456f-b7cd-31508e47f1e9 tempest-VolumesListAdminTestJSON-622303885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:44:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-48dfa51e-a6a3-456f-b7cd-31508e47f1e9 tempest-VolumesListAdminTestJSON-622303885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:44:04 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-48dfa51e-a6a3-456f-b7cd-31508e47f1e9 tempest-VolumesListAdminTestJSON-622303885 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1090626836',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c61b70e-3d0c-4cd3-9b09-2e5889a634aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eee6a8f33c14b518a8141de3d440d4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:44:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:44:04Z,use_quota=True,user_id='837c22e8c8c04e58b89e4ad2c99d3ccc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:44:04 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-48dfa51e-a6a3-456f-b7cd-31508e47f1e9 tempest-VolumesListAdminTestJSON-622303885 None] Creating volume 0c61b70e-3d0c-4cd3-9b09-2e5889a634aa {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:44:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-48dfa51e-a6a3-456f-b7cd-31508e47f1e9 tempest-VolumesListAdminTestJSON-622303885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:44:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-48dfa51e-a6a3-456f-b7cd-31508e47f1e9 tempest-VolumesListAdminTestJSON-622303885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:44:04 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-48dfa51e-a6a3-456f-b7cd-31508e47f1e9 tempest-VolumesListAdminTestJSON-622303885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:44:04 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-48dfa51e-a6a3-456f-b7cd-31508e47f1e9 tempest-VolumesListAdminTestJSON-622303885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:44:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-48dfa51e-a6a3-456f-b7cd-31508e47f1e9 tempest-VolumesListAdminTestJSON-622303885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:44:04 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-48dfa51e-a6a3-456f-b7cd-31508e47f1e9 tempest-VolumesListAdminTestJSON-622303885 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:44:04 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-48dfa51e-a6a3-456f-b7cd-31508e47f1e9 tempest-VolumesListAdminTestJSON-622303885 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:44:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-48dfa51e-a6a3-456f-b7cd-31508e47f1e9 tempest-VolumesListAdminTestJSON-622303885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0c61b70e-3d0c-4cd3-9b09-2e5889a634aa 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:04 devstack sudo[87622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0c61b70e-3d0c-4cd3-9b09-2e5889a634aa 1073741824
Feb 28 04:44:04 devstack sudo[87622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:04 devstack cinder-volume[84248]: DEBUG dbcounter [-] [84248] Writing DB stats cinder:UPDATE=200,cinder:SELECT=201,cinder:INSERT=65,cinder:DELETE=7 {{(pid=84248) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 04:44:04 devstack cinder-volume[84248]: DEBUG dbcounter [-] [84248] Writing DB stats cinder:DELETE=13,cinder:SELECT=170,cinder:UPDATE=185,cinder:INSERT=42 {{(pid=84248) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 04:44:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5ecfbd26-5731-4c23-a442-d467770b43b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:44:05 devstack sudo[87622]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-48dfa51e-a6a3-456f-b7cd-31508e47f1e9 tempest-VolumesListAdminTestJSON-622303885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0c61b70e-3d0c-4cd3-9b09-2e5889a634aa 1073741824" returned: 0 in 0.607s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-48dfa51e-a6a3-456f-b7cd-31508e47f1e9 tempest-VolumesListAdminTestJSON-622303885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0c61b70e-3d0c-4cd3-9b09-2e5889a634aa {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:05 devstack sudo[87627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0c61b70e-3d0c-4cd3-9b09-2e5889a634aa
Feb 28 04:44:05 devstack sudo[87627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:05 devstack sudo[87627]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-48dfa51e-a6a3-456f-b7cd-31508e47f1e9 tempest-VolumesListAdminTestJSON-622303885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0c61b70e-3d0c-4cd3-9b09-2e5889a634aa" returned: 0 in 0.508s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:05 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-48dfa51e-a6a3-456f-b7cd-31508e47f1e9 tempest-VolumesListAdminTestJSON-622303885 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:44:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-48dfa51e-a6a3-456f-b7cd-31508e47f1e9 tempest-VolumesListAdminTestJSON-622303885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:44:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5ecfbd26-5731-4c23-a442-d467770b43b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.835s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:44:05 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-48dfa51e-a6a3-456f-b7cd-31508e47f1e9 tempest-VolumesListAdminTestJSON-622303885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe134637-5460-45fd-b1c4-1f566eda7bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c61b70e-3d0c-4cd3-9b09-2e5889a634aa', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:05 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-48dfa51e-a6a3-456f-b7cd-31508e47f1e9 tempest-VolumesListAdminTestJSON-622303885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc65cb05-ded3-4108-b375-319623544b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:05 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-5ecfbd26-5731-4c23-a442-d467770b43b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Creating offline snapshot 2d945d94-06d5-4c42-988e-7ca807d1068e of volume edc48f38-4638-4efd-abc2-98e0be3c2a4b {{(pid=84248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 04:44:05 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-48dfa51e-a6a3-456f-b7cd-31508e47f1e9 tempest-VolumesListAdminTestJSON-622303885 None] Volume volume-0c61b70e-3d0c-4cd3-9b09-2e5889a634aa (0c61b70e-3d0c-4cd3-9b09-2e5889a634aa): created successfully
Feb 28 04:44:05 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-48dfa51e-a6a3-456f-b7cd-31508e47f1e9 tempest-VolumesListAdminTestJSON-622303885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc65cb05-ded3-4108-b375-319623544b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:05 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-48dfa51e-a6a3-456f-b7cd-31508e47f1e9 tempest-VolumesListAdminTestJSON-622303885 None] Flow 'volume_create_manager' (94fddfde-1363-4827-bf90-e1a975c83b13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:44:05 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[47232dab-c4c0-45d6-b5c1-49fd20027b74]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:44:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5ecfbd26-5731-4c23-a442-d467770b43b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:05 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-48dfa51e-a6a3-456f-b7cd-31508e47f1e9 tempest-VolumesListAdminTestJSON-622303885 None] Created volume successfully.
Feb 28 04:44:05 devstack sudo[87631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b
Feb 28 04:44:05 devstack sudo[87631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:06 devstack sudo[87631]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5ecfbd26-5731-4c23-a442-d467770b43b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b" returned: 0 in 0.537s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5ecfbd26-5731-4c23-a442-d467770b43b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b.2d945d94-06d5-4c42-988e-7ca807d1068e 1G {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:06 devstack sudo[87636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b.2d945d94-06d5-4c42-988e-7ca807d1068e 1G
Feb 28 04:44:06 devstack sudo[87636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:06 devstack sudo[87636]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5ecfbd26-5731-4c23-a442-d467770b43b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b.2d945d94-06d5-4c42-988e-7ca807d1068e 1G" returned: 0 in 0.567s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5ecfbd26-5731-4c23-a442-d467770b43b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b.2d945d94-06d5-4c42-988e-7ca807d1068e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:06 devstack sudo[87641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b.2d945d94-06d5-4c42-988e-7ca807d1068e
Feb 28 04:44:06 devstack sudo[87641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:06 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-a77edb94-6919-4f7f-9817-7632a8f71b68 tempest-VolumesListAdminTestJSON-622303885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:44:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a77edb94-6919-4f7f-9817-7632a8f71b68 tempest-VolumesListAdminTestJSON-622303885 None] Flow 'volume_create_manager' (46a51ec8-f82f-4706-b596-1e7a31ca228e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:44:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a77edb94-6919-4f7f-9817-7632a8f71b68 tempest-VolumesListAdminTestJSON-622303885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3bd8aa6-001d-475f-993e-2b2dc2ad9744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a77edb94-6919-4f7f-9817-7632a8f71b68 tempest-VolumesListAdminTestJSON-622303885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3bd8aa6-001d-475f-993e-2b2dc2ad9744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:44:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-581671861',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96548735-93d8-4c36-8439-43a704e0e66d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eee6a8f33c14b518a8141de3d440d4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:44:07Z,use_quota=True,user_id='837c22e8c8c04e58b89e4ad2c99d3ccc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a77edb94-6919-4f7f-9817-7632a8f71b68 tempest-VolumesListAdminTestJSON-622303885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db8f37cb-1c64-4918-a7b2-7f09d8c7e180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a77edb94-6919-4f7f-9817-7632a8f71b68 tempest-VolumesListAdminTestJSON-622303885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db8f37cb-1c64-4918-a7b2-7f09d8c7e180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a77edb94-6919-4f7f-9817-7632a8f71b68 tempest-VolumesListAdminTestJSON-622303885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a648892-879b-471b-8e66-4c542e22804d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a77edb94-6919-4f7f-9817-7632a8f71b68 tempest-VolumesListAdminTestJSON-622303885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a648892-879b-471b-8e66-4c542e22804d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96548735-93d8-4c36-8439-43a704e0e66d', 'volume_name': 'volume-96548735-93d8-4c36-8439-43a704e0e66d', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a77edb94-6919-4f7f-9817-7632a8f71b68 tempest-VolumesListAdminTestJSON-622303885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc381e06-cae4-4bd7-b06a-354a88014aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a77edb94-6919-4f7f-9817-7632a8f71b68 tempest-VolumesListAdminTestJSON-622303885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc381e06-cae4-4bd7-b06a-354a88014aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a77edb94-6919-4f7f-9817-7632a8f71b68 tempest-VolumesListAdminTestJSON-622303885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c901138e-186e-42db-bb24-9e275f065ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:06 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-a77edb94-6919-4f7f-9817-7632a8f71b68 tempest-VolumesListAdminTestJSON-622303885 None] Volume 96548735-93d8-4c36-8439-43a704e0e66d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96548735-93d8-4c36-8439-43a704e0e66d', 'volume_size': 1}
Feb 28 04:44:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a77edb94-6919-4f7f-9817-7632a8f71b68 tempest-VolumesListAdminTestJSON-622303885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:44:07 devstack sudo[87641]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5ecfbd26-5731-4c23-a442-d467770b43b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b.2d945d94-06d5-4c42-988e-7ca807d1068e" returned: 0 in 0.492s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:07 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-5ecfbd26-5731-4c23-a442-d467770b43b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b.2d945d94-06d5-4c42-988e-7ca807d1068e is being set with open permissions: ugo+rw
Feb 28 04:44:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5ecfbd26-5731-4c23-a442-d467770b43b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b.2d945d94-06d5-4c42-988e-7ca807d1068e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:07 devstack sudo[87646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b.2d945d94-06d5-4c42-988e-7ca807d1068e
Feb 28 04:44:07 devstack sudo[87646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:07 devstack sudo[87646]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5ecfbd26-5731-4c23-a442-d467770b43b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b.2d945d94-06d5-4c42-988e-7ca807d1068e" returned: 0 in 0.456s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5ecfbd26-5731-4c23-a442-d467770b43b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:07 devstack sudo[87649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b.info
Feb 28 04:44:07 devstack sudo[87649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:08 devstack sudo[87649]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5ecfbd26-5731-4c23-a442-d467770b43b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b.info" returned: 0 in 0.439s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:08 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-5ecfbd26-5731-4c23-a442-d467770b43b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b.info is being set with open permissions: ugo+rw
Feb 28 04:44:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5ecfbd26-5731-4c23-a442-d467770b43b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:08 devstack sudo[87652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b.info
Feb 28 04:44:08 devstack sudo[87652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:08 devstack sudo[87652]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5ecfbd26-5731-4c23-a442-d467770b43b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b.info" returned: 0 in 0.482s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5ecfbd26-5731-4c23-a442-d467770b43b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.060s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:44:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a77edb94-6919-4f7f-9817-7632a8f71b68 tempest-VolumesListAdminTestJSON-622303885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.768s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:44:08 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-a77edb94-6919-4f7f-9817-7632a8f71b68 tempest-VolumesListAdminTestJSON-622303885 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:44:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-581671861',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96548735-93d8-4c36-8439-43a704e0e66d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eee6a8f33c14b518a8141de3d440d4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:44:07Z,use_quota=True,user_id='837c22e8c8c04e58b89e4ad2c99d3ccc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:44:08 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-a77edb94-6919-4f7f-9817-7632a8f71b68 tempest-VolumesListAdminTestJSON-622303885 None] Creating volume 96548735-93d8-4c36-8439-43a704e0e66d {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:44:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a77edb94-6919-4f7f-9817-7632a8f71b68 tempest-VolumesListAdminTestJSON-622303885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:44:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a77edb94-6919-4f7f-9817-7632a8f71b68 tempest-VolumesListAdminTestJSON-622303885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:44:08 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-a77edb94-6919-4f7f-9817-7632a8f71b68 tempest-VolumesListAdminTestJSON-622303885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:44:08 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-a77edb94-6919-4f7f-9817-7632a8f71b68 tempest-VolumesListAdminTestJSON-622303885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:44:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a77edb94-6919-4f7f-9817-7632a8f71b68 tempest-VolumesListAdminTestJSON-622303885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:44:08 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-a77edb94-6919-4f7f-9817-7632a8f71b68 tempest-VolumesListAdminTestJSON-622303885 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:44:08 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-a77edb94-6919-4f7f-9817-7632a8f71b68 tempest-VolumesListAdminTestJSON-622303885 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:44:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a77edb94-6919-4f7f-9817-7632a8f71b68 tempest-VolumesListAdminTestJSON-622303885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-96548735-93d8-4c36-8439-43a704e0e66d 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:08 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-5ecfbd26-5731-4c23-a442-d467770b43b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Create snapshot completed successfully
Feb 28 04:44:08 devstack sudo[87655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-96548735-93d8-4c36-8439-43a704e0e66d 1073741824
Feb 28 04:44:08 devstack sudo[87655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:09 devstack sudo[87655]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:09 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a77edb94-6919-4f7f-9817-7632a8f71b68 tempest-VolumesListAdminTestJSON-622303885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-96548735-93d8-4c36-8439-43a704e0e66d 1073741824" returned: 0 in 0.598s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:09 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ad25eb75-546d-4f5b-b82c-4946cd384593 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Acquiring lock "cinder-2d945d94-06d5-4c42-988e-7ca807d1068e-delete_snapshot" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:44:09 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a77edb94-6919-4f7f-9817-7632a8f71b68 tempest-VolumesListAdminTestJSON-622303885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-96548735-93d8-4c36-8439-43a704e0e66d {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:09 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ad25eb75-546d-4f5b-b82c-4946cd384593 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Lock "cinder-2d945d94-06d5-4c42-988e-7ca807d1068e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:44:09 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ad25eb75-546d-4f5b-b82c-4946cd384593 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Acquiring lock "cinder-quobyte-edc48f38-4638-4efd-abc2-98e0be3c2a4b" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:44:09 devstack sudo[87660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-96548735-93d8-4c36-8439-43a704e0e66d
Feb 28 04:44:09 devstack sudo[87660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:09 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ad25eb75-546d-4f5b-b82c-4946cd384593 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Lock "cinder-quobyte-edc48f38-4638-4efd-abc2-98e0be3c2a4b" acquired by "delete_snapshot" :: waited 0.053s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:44:09 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ad25eb75-546d-4f5b-b82c-4946cd384593 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Acquiring lock "cinder-quobyte-2d945d94-06d5-4c42-988e-7ca807d1068e" by "_delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:44:09 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ad25eb75-546d-4f5b-b82c-4946cd384593 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Lock "cinder-quobyte-2d945d94-06d5-4c42-988e-7ca807d1068e" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:44:09 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-ad25eb75-546d-4f5b-b82c-4946cd384593 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Deleting offline snapshot 2d945d94-06d5-4c42-988e-7ca807d1068e of volume edc48f38-4638-4efd-abc2-98e0be3c2a4b {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 04:44:09 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-ad25eb75-546d-4f5b-b82c-4946cd384593 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] snapshot_file for this snap is: volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b.2d945d94-06d5-4c42-988e-7ca807d1068e {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 04:44:09 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[af35b000-ce6b-4cc7-92f5-e3a11fe798cf]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:44:09 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ad25eb75-546d-4f5b-b82c-4946cd384593 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b.2d945d94-06d5-4c42-988e-7ca807d1068e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:09 devstack sudo[87662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b.2d945d94-06d5-4c42-988e-7ca807d1068e
Feb 28 04:44:09 devstack sudo[87662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:09 devstack sudo[87660]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:09 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a77edb94-6919-4f7f-9817-7632a8f71b68 tempest-VolumesListAdminTestJSON-622303885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-96548735-93d8-4c36-8439-43a704e0e66d" returned: 0 in 0.510s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:09 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-a77edb94-6919-4f7f-9817-7632a8f71b68 tempest-VolumesListAdminTestJSON-622303885 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:44:09 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a77edb94-6919-4f7f-9817-7632a8f71b68 tempest-VolumesListAdminTestJSON-622303885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:44:09 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a77edb94-6919-4f7f-9817-7632a8f71b68 tempest-VolumesListAdminTestJSON-622303885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c901138e-186e-42db-bb24-9e275f065ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96548735-93d8-4c36-8439-43a704e0e66d', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:09 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a77edb94-6919-4f7f-9817-7632a8f71b68 tempest-VolumesListAdminTestJSON-622303885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8f55199-0ea4-4fb8-85dd-023f839d7a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:09 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-a77edb94-6919-4f7f-9817-7632a8f71b68 tempest-VolumesListAdminTestJSON-622303885 None] Volume volume-96548735-93d8-4c36-8439-43a704e0e66d (96548735-93d8-4c36-8439-43a704e0e66d): created successfully
Feb 28 04:44:09 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a77edb94-6919-4f7f-9817-7632a8f71b68 tempest-VolumesListAdminTestJSON-622303885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8f55199-0ea4-4fb8-85dd-023f839d7a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:09 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a77edb94-6919-4f7f-9817-7632a8f71b68 tempest-VolumesListAdminTestJSON-622303885 None] Flow 'volume_create_manager' (46a51ec8-f82f-4706-b596-1e7a31ca228e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:44:09 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-a77edb94-6919-4f7f-9817-7632a8f71b68 tempest-VolumesListAdminTestJSON-622303885 None] Created volume successfully.
Feb 28 04:44:10 devstack sudo[87662]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ad25eb75-546d-4f5b-b82c-4946cd384593 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b.2d945d94-06d5-4c42-988e-7ca807d1068e" returned: 0 in 0.749s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:10 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-ad25eb75-546d-4f5b-b82c-4946cd384593 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:44:10 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[7996b8a8-42f0-4632-8f2e-4d4c1c8a067a]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:44:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ad25eb75-546d-4f5b-b82c-4946cd384593 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:10 devstack sudo[87670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b
Feb 28 04:44:10 devstack sudo[87670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:10 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-82121161-875e-44f4-8085-7fbcb1828be8 tempest-VolumesListAdminTestJSON-622303885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:44:10 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-82121161-875e-44f4-8085-7fbcb1828be8 tempest-VolumesListAdminTestJSON-622303885 None] Flow 'volume_create_manager' (029bdafa-bcff-4caa-bfb7-f1bca40935ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:44:10 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-82121161-875e-44f4-8085-7fbcb1828be8 tempest-VolumesListAdminTestJSON-622303885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8cc260c-7faf-478d-829b-6573a707bf34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:10 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-82121161-875e-44f4-8085-7fbcb1828be8 tempest-VolumesListAdminTestJSON-622303885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8cc260c-7faf-478d-829b-6573a707bf34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:44:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1506019407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=482c4e3a-5550-41c8-a5ab-7c555c8f95eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eee6a8f33c14b518a8141de3d440d4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:44:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:44:11Z,use_quota=True,user_id='837c22e8c8c04e58b89e4ad2c99d3ccc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:10 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-82121161-875e-44f4-8085-7fbcb1828be8 tempest-VolumesListAdminTestJSON-622303885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dddaf035-b426-400a-89f2-96e488debf16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:10 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-82121161-875e-44f4-8085-7fbcb1828be8 tempest-VolumesListAdminTestJSON-622303885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dddaf035-b426-400a-89f2-96e488debf16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:10 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-82121161-875e-44f4-8085-7fbcb1828be8 tempest-VolumesListAdminTestJSON-622303885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c994d064-fa11-4619-9a04-15e3b5bab65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:10 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-82121161-875e-44f4-8085-7fbcb1828be8 tempest-VolumesListAdminTestJSON-622303885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c994d064-fa11-4619-9a04-15e3b5bab65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '482c4e3a-5550-41c8-a5ab-7c555c8f95eb', 'volume_name': 'volume-482c4e3a-5550-41c8-a5ab-7c555c8f95eb', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:10 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-82121161-875e-44f4-8085-7fbcb1828be8 tempest-VolumesListAdminTestJSON-622303885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1abe2347-d94a-4323-a292-b93213eb6968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:10 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-82121161-875e-44f4-8085-7fbcb1828be8 tempest-VolumesListAdminTestJSON-622303885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1abe2347-d94a-4323-a292-b93213eb6968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:10 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-82121161-875e-44f4-8085-7fbcb1828be8 tempest-VolumesListAdminTestJSON-622303885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b63071f-68d0-4c96-8b2c-16e6c0e4d9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:10 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-82121161-875e-44f4-8085-7fbcb1828be8 tempest-VolumesListAdminTestJSON-622303885 None] Volume 482c4e3a-5550-41c8-a5ab-7c555c8f95eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-482c4e3a-5550-41c8-a5ab-7c555c8f95eb', 'volume_size': 1}
Feb 28 04:44:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-82121161-875e-44f4-8085-7fbcb1828be8 tempest-VolumesListAdminTestJSON-622303885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:44:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-82121161-875e-44f4-8085-7fbcb1828be8 tempest-VolumesListAdminTestJSON-622303885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:44:10 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-82121161-875e-44f4-8085-7fbcb1828be8 tempest-VolumesListAdminTestJSON-622303885 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:44:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1506019407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=482c4e3a-5550-41c8-a5ab-7c555c8f95eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eee6a8f33c14b518a8141de3d440d4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:44:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:44:11Z,use_quota=True,user_id='837c22e8c8c04e58b89e4ad2c99d3ccc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:44:10 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-82121161-875e-44f4-8085-7fbcb1828be8 tempest-VolumesListAdminTestJSON-622303885 None] Creating volume 482c4e3a-5550-41c8-a5ab-7c555c8f95eb {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:44:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-82121161-875e-44f4-8085-7fbcb1828be8 tempest-VolumesListAdminTestJSON-622303885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:44:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-82121161-875e-44f4-8085-7fbcb1828be8 tempest-VolumesListAdminTestJSON-622303885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:44:10 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-82121161-875e-44f4-8085-7fbcb1828be8 tempest-VolumesListAdminTestJSON-622303885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:44:10 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-82121161-875e-44f4-8085-7fbcb1828be8 tempest-VolumesListAdminTestJSON-622303885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:44:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-82121161-875e-44f4-8085-7fbcb1828be8 tempest-VolumesListAdminTestJSON-622303885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:44:10 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-82121161-875e-44f4-8085-7fbcb1828be8 tempest-VolumesListAdminTestJSON-622303885 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:44:10 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-82121161-875e-44f4-8085-7fbcb1828be8 tempest-VolumesListAdminTestJSON-622303885 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:44:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-82121161-875e-44f4-8085-7fbcb1828be8 tempest-VolumesListAdminTestJSON-622303885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-482c4e3a-5550-41c8-a5ab-7c555c8f95eb 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:10 devstack sudo[87672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-482c4e3a-5550-41c8-a5ab-7c555c8f95eb 1073741824
Feb 28 04:44:10 devstack sudo[87672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:10 devstack sudo[87670]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ad25eb75-546d-4f5b-b82c-4946cd384593 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b" returned: 0 in 0.633s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ad25eb75-546d-4f5b-b82c-4946cd384593 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b.2d945d94-06d5-4c42-988e-7ca807d1068e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:10 devstack sudo[87677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b.2d945d94-06d5-4c42-988e-7ca807d1068e
Feb 28 04:44:10 devstack sudo[87677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:11 devstack sudo[87672]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-82121161-875e-44f4-8085-7fbcb1828be8 tempest-VolumesListAdminTestJSON-622303885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-482c4e3a-5550-41c8-a5ab-7c555c8f95eb 1073741824" returned: 0 in 0.594s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-82121161-875e-44f4-8085-7fbcb1828be8 tempest-VolumesListAdminTestJSON-622303885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-482c4e3a-5550-41c8-a5ab-7c555c8f95eb {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:11 devstack sudo[87682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-482c4e3a-5550-41c8-a5ab-7c555c8f95eb
Feb 28 04:44:11 devstack sudo[87682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:11 devstack sudo[87677]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ad25eb75-546d-4f5b-b82c-4946cd384593 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b.2d945d94-06d5-4c42-988e-7ca807d1068e" returned: 0 in 0.596s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ad25eb75-546d-4f5b-b82c-4946cd384593 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b.2d945d94-06d5-4c42-988e-7ca807d1068e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:11 devstack sudo[87687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b.2d945d94-06d5-4c42-988e-7ca807d1068e
Feb 28 04:44:11 devstack sudo[87687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:11 devstack sudo[87682]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-82121161-875e-44f4-8085-7fbcb1828be8 tempest-VolumesListAdminTestJSON-622303885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-482c4e3a-5550-41c8-a5ab-7c555c8f95eb" returned: 0 in 0.600s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:11 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-82121161-875e-44f4-8085-7fbcb1828be8 tempest-VolumesListAdminTestJSON-622303885 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:44:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-82121161-875e-44f4-8085-7fbcb1828be8 tempest-VolumesListAdminTestJSON-622303885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:44:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-82121161-875e-44f4-8085-7fbcb1828be8 tempest-VolumesListAdminTestJSON-622303885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b63071f-68d0-4c96-8b2c-16e6c0e4d9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-482c4e3a-5550-41c8-a5ab-7c555c8f95eb', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-82121161-875e-44f4-8085-7fbcb1828be8 tempest-VolumesListAdminTestJSON-622303885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c27f7049-2183-470e-b4d2-f9340e4946f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:11 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-82121161-875e-44f4-8085-7fbcb1828be8 tempest-VolumesListAdminTestJSON-622303885 None] Volume volume-482c4e3a-5550-41c8-a5ab-7c555c8f95eb (482c4e3a-5550-41c8-a5ab-7c555c8f95eb): created successfully
Feb 28 04:44:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-82121161-875e-44f4-8085-7fbcb1828be8 tempest-VolumesListAdminTestJSON-622303885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c27f7049-2183-470e-b4d2-f9340e4946f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-82121161-875e-44f4-8085-7fbcb1828be8 tempest-VolumesListAdminTestJSON-622303885 None] Flow 'volume_create_manager' (029bdafa-bcff-4caa-bfb7-f1bca40935ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:44:11 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-82121161-875e-44f4-8085-7fbcb1828be8 tempest-VolumesListAdminTestJSON-622303885 None] Created volume successfully.
Feb 28 04:44:12 devstack sudo[87687]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ad25eb75-546d-4f5b-b82c-4946cd384593 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b.2d945d94-06d5-4c42-988e-7ca807d1068e" returned: 0 in 0.509s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:12 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ad25eb75-546d-4f5b-b82c-4946cd384593 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Lock "cinder-quobyte-2d945d94-06d5-4c42-988e-7ca807d1068e" released by "_delete_snapshot" :: held 2.552s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:44:12 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ad25eb75-546d-4f5b-b82c-4946cd384593 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Lock "cinder-quobyte-edc48f38-4638-4efd-abc2-98e0be3c2a4b" released by "delete_snapshot" :: held 2.568s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:44:12 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-ad25eb75-546d-4f5b-b82c-4946cd384593 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Created reservations ['3fa7d5b4-0052-4717-af4c-6ac61bc11ed7', 'a465f391-ba0c-419e-83e4-d5781a5e45c0', 'b451ea78-0a7c-48d8-85d9-31b9c1667559', 'ba2272a1-4108-4285-ada8-2bedb7dc2840'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:44:12 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-ad25eb75-546d-4f5b-b82c-4946cd384593 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Delete snapshot completed successfully.
Feb 28 04:44:12 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ad25eb75-546d-4f5b-b82c-4946cd384593 tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Lock "cinder-2d945d94-06d5-4c42-988e-7ca807d1068e-delete_snapshot" released by "delete_snapshot" :: held 2.714s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:44:12 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f1d6c425-005c-4883-851f-3731bf90f3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Acquiring lock "cinder-edc48f38-4638-4efd-abc2-98e0be3c2a4b-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:44:12 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f1d6c425-005c-4883-851f-3731bf90f3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Lock "cinder-edc48f38-4638-4efd-abc2-98e0be3c2a4b-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:44:12 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f1d6c425-005c-4883-851f-3731bf90f3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Acquiring lock "cinder-quobyte-edc48f38-4638-4efd-abc2-98e0be3c2a4b" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:44:12 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f1d6c425-005c-4883-851f-3731bf90f3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Lock "cinder-quobyte-edc48f38-4638-4efd-abc2-98e0be3c2a4b" acquired by "delete_volume" :: waited 0.012s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:44:12 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4ade4c-7147-4c2c-b518-2fe59f86d1a5]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:44:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f1d6c425-005c-4883-851f-3731bf90f3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:12 devstack sudo[87692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b
Feb 28 04:44:12 devstack sudo[87692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:13 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6022e96-aa3a-4835-86e3-d10a5caa7b1d tempest-VolumesListAdminTestJSON-483945122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:44:13 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-c6022e96-aa3a-4835-86e3-d10a5caa7b1d tempest-VolumesListAdminTestJSON-483945122 None] Flow 'volume_create_manager' (f7fa97cd-ba81-4efb-9793-fdb51cacf3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:44:13 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-c6022e96-aa3a-4835-86e3-d10a5caa7b1d tempest-VolumesListAdminTestJSON-483945122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a70ebe95-352f-4c99-bf04-034892d0381b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:13 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-c6022e96-aa3a-4835-86e3-d10a5caa7b1d tempest-VolumesListAdminTestJSON-483945122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a70ebe95-352f-4c99-bf04-034892d0381b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cab5b4c-00be-4a00-9cde-651600596766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1b35f2608e3485bbcb422c0a50eeaaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:44:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:44:13Z,use_quota=True,user_id='ea3f252d44984c57b91d4a7892ae4510',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:13 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-c6022e96-aa3a-4835-86e3-d10a5caa7b1d tempest-VolumesListAdminTestJSON-483945122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c1401c0-d719-4a3d-9a90-ab5b79f24d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:13 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-c6022e96-aa3a-4835-86e3-d10a5caa7b1d tempest-VolumesListAdminTestJSON-483945122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c1401c0-d719-4a3d-9a90-ab5b79f24d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:13 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-c6022e96-aa3a-4835-86e3-d10a5caa7b1d tempest-VolumesListAdminTestJSON-483945122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be1a1f06-a19d-4ff8-8204-fd5fed59e921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:13 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-c6022e96-aa3a-4835-86e3-d10a5caa7b1d tempest-VolumesListAdminTestJSON-483945122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be1a1f06-a19d-4ff8-8204-fd5fed59e921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cab5b4c-00be-4a00-9cde-651600596766', 'volume_name': 'volume-2cab5b4c-00be-4a00-9cde-651600596766', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:13 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-c6022e96-aa3a-4835-86e3-d10a5caa7b1d tempest-VolumesListAdminTestJSON-483945122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d5ce16e-30d7-471f-aed1-c15784ad1d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:13 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-c6022e96-aa3a-4835-86e3-d10a5caa7b1d tempest-VolumesListAdminTestJSON-483945122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d5ce16e-30d7-471f-aed1-c15784ad1d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:13 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-c6022e96-aa3a-4835-86e3-d10a5caa7b1d tempest-VolumesListAdminTestJSON-483945122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72a435cf-d17a-4636-9da7-a0f64183e0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:13 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-c6022e96-aa3a-4835-86e3-d10a5caa7b1d tempest-VolumesListAdminTestJSON-483945122 None] Volume 2cab5b4c-00be-4a00-9cde-651600596766: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cab5b4c-00be-4a00-9cde-651600596766', 'volume_size': 1}
Feb 28 04:44:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-c6022e96-aa3a-4835-86e3-d10a5caa7b1d tempest-VolumesListAdminTestJSON-483945122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:44:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-c6022e96-aa3a-4835-86e3-d10a5caa7b1d tempest-VolumesListAdminTestJSON-483945122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:44:13 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-c6022e96-aa3a-4835-86e3-d10a5caa7b1d tempest-VolumesListAdminTestJSON-483945122 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cab5b4c-00be-4a00-9cde-651600596766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1b35f2608e3485bbcb422c0a50eeaaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:44:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:44:13Z,use_quota=True,user_id='ea3f252d44984c57b91d4a7892ae4510',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:44:13 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-c6022e96-aa3a-4835-86e3-d10a5caa7b1d tempest-VolumesListAdminTestJSON-483945122 None] Creating volume 2cab5b4c-00be-4a00-9cde-651600596766 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:44:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-c6022e96-aa3a-4835-86e3-d10a5caa7b1d tempest-VolumesListAdminTestJSON-483945122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:44:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-c6022e96-aa3a-4835-86e3-d10a5caa7b1d tempest-VolumesListAdminTestJSON-483945122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:44:13 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-c6022e96-aa3a-4835-86e3-d10a5caa7b1d tempest-VolumesListAdminTestJSON-483945122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:44:13 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-c6022e96-aa3a-4835-86e3-d10a5caa7b1d tempest-VolumesListAdminTestJSON-483945122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:44:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-c6022e96-aa3a-4835-86e3-d10a5caa7b1d tempest-VolumesListAdminTestJSON-483945122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:44:13 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-c6022e96-aa3a-4835-86e3-d10a5caa7b1d tempest-VolumesListAdminTestJSON-483945122 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:44:13 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-c6022e96-aa3a-4835-86e3-d10a5caa7b1d tempest-VolumesListAdminTestJSON-483945122 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:44:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-c6022e96-aa3a-4835-86e3-d10a5caa7b1d tempest-VolumesListAdminTestJSON-483945122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2cab5b4c-00be-4a00-9cde-651600596766 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:13 devstack sudo[87697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2cab5b4c-00be-4a00-9cde-651600596766 1073741824
Feb 28 04:44:13 devstack sudo[87697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:13 devstack sudo[87692]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f1d6c425-005c-4883-851f-3731bf90f3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b" returned: 0 in 0.702s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f1d6c425-005c-4883-851f-3731bf90f3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:13 devstack sudo[87699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b
Feb 28 04:44:13 devstack sudo[87699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:13 devstack sudo[87697]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-c6022e96-aa3a-4835-86e3-d10a5caa7b1d tempest-VolumesListAdminTestJSON-483945122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2cab5b4c-00be-4a00-9cde-651600596766 1073741824" returned: 0 in 0.629s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-c6022e96-aa3a-4835-86e3-d10a5caa7b1d tempest-VolumesListAdminTestJSON-483945122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2cab5b4c-00be-4a00-9cde-651600596766 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:13 devstack sudo[87705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2cab5b4c-00be-4a00-9cde-651600596766
Feb 28 04:44:13 devstack sudo[87705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:14 devstack sudo[87699]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f1d6c425-005c-4883-851f-3731bf90f3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-edc48f38-4638-4efd-abc2-98e0be3c2a4b" returned: 0 in 0.652s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:14 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f1d6c425-005c-4883-851f-3731bf90f3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Lock "cinder-quobyte-edc48f38-4638-4efd-abc2-98e0be3c2a4b" released by "delete_volume" :: held 1.416s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:44:14 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-f1d6c425-005c-4883-851f-3731bf90f3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Created reservations ['eac839d6-69f3-4895-9918-89a899e76642', 'd4152a72-2af5-4161-b37e-025645fb09fc', 'aaca9ede-afbd-49d9-a2e1-098f600d5e08', '0c210727-0896-46c2-afee-38fb562b87cc'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:44:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-f1d6c425-005c-4883-851f-3731bf90f3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:44:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-f1d6c425-005c-4883-851f-3731bf90f3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:44:14 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-f1d6c425-005c-4883-851f-3731bf90f3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:44:14 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-f1d6c425-005c-4883-851f-3731bf90f3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:44:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-f1d6c425-005c-4883-851f-3731bf90f3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:44:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f1d6c425-005c-4883-851f-3731bf90f3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:14 devstack sudo[87707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:44:14 devstack sudo[87707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:14 devstack sudo[87705]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-c6022e96-aa3a-4835-86e3-d10a5caa7b1d tempest-VolumesListAdminTestJSON-483945122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2cab5b4c-00be-4a00-9cde-651600596766" returned: 0 in 0.622s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:14 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-c6022e96-aa3a-4835-86e3-d10a5caa7b1d tempest-VolumesListAdminTestJSON-483945122 None] <== create_volume: return (1280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:44:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-c6022e96-aa3a-4835-86e3-d10a5caa7b1d tempest-VolumesListAdminTestJSON-483945122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:44:14 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-c6022e96-aa3a-4835-86e3-d10a5caa7b1d tempest-VolumesListAdminTestJSON-483945122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72a435cf-d17a-4636-9da7-a0f64183e0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cab5b4c-00be-4a00-9cde-651600596766', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:14 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-c6022e96-aa3a-4835-86e3-d10a5caa7b1d tempest-VolumesListAdminTestJSON-483945122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (525b0cca-87ce-4634-acd4-f01b5aa5c7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:14 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-c6022e96-aa3a-4835-86e3-d10a5caa7b1d tempest-VolumesListAdminTestJSON-483945122 None] Volume volume-2cab5b4c-00be-4a00-9cde-651600596766 (2cab5b4c-00be-4a00-9cde-651600596766): created successfully
Feb 28 04:44:14 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-c6022e96-aa3a-4835-86e3-d10a5caa7b1d tempest-VolumesListAdminTestJSON-483945122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (525b0cca-87ce-4634-acd4-f01b5aa5c7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:14 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-c6022e96-aa3a-4835-86e3-d10a5caa7b1d tempest-VolumesListAdminTestJSON-483945122 None] Flow 'volume_create_manager' (f7fa97cd-ba81-4efb-9793-fdb51cacf3c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:44:14 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-c6022e96-aa3a-4835-86e3-d10a5caa7b1d tempest-VolumesListAdminTestJSON-483945122 None] Created volume successfully.
Feb 28 04:44:14 devstack sudo[87707]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f1d6c425-005c-4883-851f-3731bf90f3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.575s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:14 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-f1d6c425-005c-4883-851f-3731bf90f3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:44:14 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-f1d6c425-005c-4883-851f-3731bf90f3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Deleted volume successfully.
Feb 28 04:44:14 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f1d6c425-005c-4883-851f-3731bf90f3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1738072689 None] Lock "cinder-edc48f38-4638-4efd-abc2-98e0be3c2a4b-delete_volume" released by "delete_volume" :: held 2.141s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:44:15 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-e3a29bfa-cb90-46a2-8243-53b108ab82e9 tempest-VolumesListAdminTestJSON-483945122 None] Acquiring lock "cinder-2cab5b4c-00be-4a00-9cde-651600596766-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:44:15 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-e3a29bfa-cb90-46a2-8243-53b108ab82e9 tempest-VolumesListAdminTestJSON-483945122 None] Lock "cinder-2cab5b4c-00be-4a00-9cde-651600596766-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:44:15 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-e3a29bfa-cb90-46a2-8243-53b108ab82e9 tempest-VolumesListAdminTestJSON-483945122 None] Acquiring lock "cinder-quobyte-2cab5b4c-00be-4a00-9cde-651600596766" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:44:15 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-e3a29bfa-cb90-46a2-8243-53b108ab82e9 tempest-VolumesListAdminTestJSON-483945122 None] Lock "cinder-quobyte-2cab5b4c-00be-4a00-9cde-651600596766" acquired by "delete_volume" :: waited 0.009s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:44:15 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8e45fd-b16d-4cb4-87b0-025b84d4b6ae]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:44:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e3a29bfa-cb90-46a2-8243-53b108ab82e9 tempest-VolumesListAdminTestJSON-483945122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2cab5b4c-00be-4a00-9cde-651600596766 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:15 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-9760daba-fc96-4946-a567-a5c50e97a271 tempest-VolumesListAdminTestJSON-622303885 None] Acquiring lock "cinder-482c4e3a-5550-41c8-a5ab-7c555c8f95eb-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:44:15 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-9760daba-fc96-4946-a567-a5c50e97a271 tempest-VolumesListAdminTestJSON-622303885 None] Lock "cinder-482c4e3a-5550-41c8-a5ab-7c555c8f95eb-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:44:15 devstack sudo[87713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2cab5b4c-00be-4a00-9cde-651600596766
Feb 28 04:44:15 devstack sudo[87713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:15 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-9760daba-fc96-4946-a567-a5c50e97a271 tempest-VolumesListAdminTestJSON-622303885 None] Acquiring lock "cinder-quobyte-482c4e3a-5550-41c8-a5ab-7c555c8f95eb" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:44:15 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-9760daba-fc96-4946-a567-a5c50e97a271 tempest-VolumesListAdminTestJSON-622303885 None] Lock "cinder-quobyte-482c4e3a-5550-41c8-a5ab-7c555c8f95eb" acquired by "delete_volume" :: waited 0.006s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:44:15 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[49beb796-3c42-49a2-9f5e-92bd006478e9]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:44:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9760daba-fc96-4946-a567-a5c50e97a271 tempest-VolumesListAdminTestJSON-622303885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-482c4e3a-5550-41c8-a5ab-7c555c8f95eb {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:15 devstack sudo[87715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-482c4e3a-5550-41c8-a5ab-7c555c8f95eb
Feb 28 04:44:15 devstack sudo[87715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:16 devstack sudo[87713]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e3a29bfa-cb90-46a2-8243-53b108ab82e9 tempest-VolumesListAdminTestJSON-483945122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2cab5b4c-00be-4a00-9cde-651600596766" returned: 0 in 0.687s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e3a29bfa-cb90-46a2-8243-53b108ab82e9 tempest-VolumesListAdminTestJSON-483945122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2cab5b4c-00be-4a00-9cde-651600596766 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:16 devstack sudo[87723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2cab5b4c-00be-4a00-9cde-651600596766
Feb 28 04:44:16 devstack sudo[87723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:16 devstack sudo[87715]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9760daba-fc96-4946-a567-a5c50e97a271 tempest-VolumesListAdminTestJSON-622303885 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-482c4e3a-5550-41c8-a5ab-7c555c8f95eb" returned: 0 in 0.564s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9760daba-fc96-4946-a567-a5c50e97a271 tempest-VolumesListAdminTestJSON-622303885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-482c4e3a-5550-41c8-a5ab-7c555c8f95eb {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:16 devstack sudo[87725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-482c4e3a-5550-41c8-a5ab-7c555c8f95eb
Feb 28 04:44:16 devstack sudo[87725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:16 devstack sudo[87723]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e3a29bfa-cb90-46a2-8243-53b108ab82e9 tempest-VolumesListAdminTestJSON-483945122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2cab5b4c-00be-4a00-9cde-651600596766" returned: 0 in 0.635s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:16 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-e3a29bfa-cb90-46a2-8243-53b108ab82e9 tempest-VolumesListAdminTestJSON-483945122 None] Lock "cinder-quobyte-2cab5b4c-00be-4a00-9cde-651600596766" released by "delete_volume" :: held 1.347s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:44:16 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-e3a29bfa-cb90-46a2-8243-53b108ab82e9 tempest-VolumesListAdminTestJSON-483945122 None] Created reservations ['128fc971-60b3-4de4-a3a4-1dad89b23432', '61e5bccc-6cef-416e-8896-8a0186aed03f', '3168e322-3268-4531-a625-c4111abb51b0', 'b63a005c-1bf7-4b21-b4d7-86d22c384add'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:44:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e3a29bfa-cb90-46a2-8243-53b108ab82e9 tempest-VolumesListAdminTestJSON-483945122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:44:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e3a29bfa-cb90-46a2-8243-53b108ab82e9 tempest-VolumesListAdminTestJSON-483945122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:44:16 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-e3a29bfa-cb90-46a2-8243-53b108ab82e9 tempest-VolumesListAdminTestJSON-483945122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:44:16 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-e3a29bfa-cb90-46a2-8243-53b108ab82e9 tempest-VolumesListAdminTestJSON-483945122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:44:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e3a29bfa-cb90-46a2-8243-53b108ab82e9 tempest-VolumesListAdminTestJSON-483945122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:44:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e3a29bfa-cb90-46a2-8243-53b108ab82e9 tempest-VolumesListAdminTestJSON-483945122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:16 devstack sudo[87762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:44:16 devstack sudo[87762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:17 devstack sudo[87725]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9760daba-fc96-4946-a567-a5c50e97a271 tempest-VolumesListAdminTestJSON-622303885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-482c4e3a-5550-41c8-a5ab-7c555c8f95eb" returned: 0 in 0.857s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:17 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-9760daba-fc96-4946-a567-a5c50e97a271 tempest-VolumesListAdminTestJSON-622303885 None] Lock "cinder-quobyte-482c4e3a-5550-41c8-a5ab-7c555c8f95eb" released by "delete_volume" :: held 1.456s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:44:17 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-9760daba-fc96-4946-a567-a5c50e97a271 tempest-VolumesListAdminTestJSON-622303885 None] Created reservations ['a33bcbe6-322e-40ce-8bb7-ee6bccab8513', 'f22a6427-bd31-4199-92fd-1e2d763d950e', '7f3b027c-5c48-46a1-94f4-28fd32734284', '5ca8dbed-2675-4858-88d6-d94bd51a8e66'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:44:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-9760daba-fc96-4946-a567-a5c50e97a271 tempest-VolumesListAdminTestJSON-622303885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:44:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-9760daba-fc96-4946-a567-a5c50e97a271 tempest-VolumesListAdminTestJSON-622303885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:44:17 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-9760daba-fc96-4946-a567-a5c50e97a271 tempest-VolumesListAdminTestJSON-622303885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:44:17 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-9760daba-fc96-4946-a567-a5c50e97a271 tempest-VolumesListAdminTestJSON-622303885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:44:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-9760daba-fc96-4946-a567-a5c50e97a271 tempest-VolumesListAdminTestJSON-622303885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:44:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9760daba-fc96-4946-a567-a5c50e97a271 tempest-VolumesListAdminTestJSON-622303885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:17 devstack sudo[87765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:44:17 devstack sudo[87765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:17 devstack sudo[87762]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e3a29bfa-cb90-46a2-8243-53b108ab82e9 tempest-VolumesListAdminTestJSON-483945122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.487s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:17 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-e3a29bfa-cb90-46a2-8243-53b108ab82e9 tempest-VolumesListAdminTestJSON-483945122 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:44:17 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-e3a29bfa-cb90-46a2-8243-53b108ab82e9 tempest-VolumesListAdminTestJSON-483945122 None] Deleted volume successfully.
Feb 28 04:44:17 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-e3a29bfa-cb90-46a2-8243-53b108ab82e9 tempest-VolumesListAdminTestJSON-483945122 None] Lock "cinder-2cab5b4c-00be-4a00-9cde-651600596766-delete_volume" released by "delete_volume" :: held 1.971s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:44:17 devstack sudo[87765]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9760daba-fc96-4946-a567-a5c50e97a271 tempest-VolumesListAdminTestJSON-622303885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.527s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:17 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-9760daba-fc96-4946-a567-a5c50e97a271 tempest-VolumesListAdminTestJSON-622303885 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:44:17 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-9760daba-fc96-4946-a567-a5c50e97a271 tempest-VolumesListAdminTestJSON-622303885 None] Deleted volume successfully.
Feb 28 04:44:17 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-9760daba-fc96-4946-a567-a5c50e97a271 tempest-VolumesListAdminTestJSON-622303885 None] Lock "cinder-482c4e3a-5550-41c8-a5ab-7c555c8f95eb-delete_volume" released by "delete_volume" :: held 2.122s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:44:17 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1ac5c01a-e95b-48bc-b947-dae58aeda555 tempest-VolumesListAdminTestJSON-622303885 None] Acquiring lock "cinder-96548735-93d8-4c36-8439-43a704e0e66d-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:44:17 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1ac5c01a-e95b-48bc-b947-dae58aeda555 tempest-VolumesListAdminTestJSON-622303885 None] Lock "cinder-96548735-93d8-4c36-8439-43a704e0e66d-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:44:17 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1ac5c01a-e95b-48bc-b947-dae58aeda555 tempest-VolumesListAdminTestJSON-622303885 None] Acquiring lock "cinder-quobyte-96548735-93d8-4c36-8439-43a704e0e66d" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:44:17 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1ac5c01a-e95b-48bc-b947-dae58aeda555 tempest-VolumesListAdminTestJSON-622303885 None] Lock "cinder-quobyte-96548735-93d8-4c36-8439-43a704e0e66d" acquired by "delete_volume" :: waited 0.011s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:44:17 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[253c2217-7b30-4f72-acc8-c74cc4ab0439]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:44:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1ac5c01a-e95b-48bc-b947-dae58aeda555 tempest-VolumesListAdminTestJSON-622303885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-96548735-93d8-4c36-8439-43a704e0e66d {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:18 devstack sudo[87769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-96548735-93d8-4c36-8439-43a704e0e66d
Feb 28 04:44:18 devstack sudo[87769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:18 devstack sudo[87769]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1ac5c01a-e95b-48bc-b947-dae58aeda555 tempest-VolumesListAdminTestJSON-622303885 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-96548735-93d8-4c36-8439-43a704e0e66d" returned: 0 in 0.586s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1ac5c01a-e95b-48bc-b947-dae58aeda555 tempest-VolumesListAdminTestJSON-622303885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-96548735-93d8-4c36-8439-43a704e0e66d {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:18 devstack sudo[87774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-96548735-93d8-4c36-8439-43a704e0e66d
Feb 28 04:44:18 devstack sudo[87774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:19 devstack sudo[87774]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1ac5c01a-e95b-48bc-b947-dae58aeda555 tempest-VolumesListAdminTestJSON-622303885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-96548735-93d8-4c36-8439-43a704e0e66d" returned: 0 in 0.519s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:19 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1ac5c01a-e95b-48bc-b947-dae58aeda555 tempest-VolumesListAdminTestJSON-622303885 None] Lock "cinder-quobyte-96548735-93d8-4c36-8439-43a704e0e66d" released by "delete_volume" :: held 1.141s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:44:19 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-1ac5c01a-e95b-48bc-b947-dae58aeda555 tempest-VolumesListAdminTestJSON-622303885 None] Created reservations ['758a7301-7207-43ec-9aca-2cc6dfac9c9f', '1471e3ab-b321-4bc3-98ab-59973d776acb', 'f3fe4f9a-b5fa-4e95-9bfb-edb0b5658c58', '2177917c-acca-4809-b880-6ca6a091f85a'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:44:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-1ac5c01a-e95b-48bc-b947-dae58aeda555 tempest-VolumesListAdminTestJSON-622303885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:44:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-1ac5c01a-e95b-48bc-b947-dae58aeda555 tempest-VolumesListAdminTestJSON-622303885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:44:19 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-1ac5c01a-e95b-48bc-b947-dae58aeda555 tempest-VolumesListAdminTestJSON-622303885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:44:19 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-1ac5c01a-e95b-48bc-b947-dae58aeda555 tempest-VolumesListAdminTestJSON-622303885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:44:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-1ac5c01a-e95b-48bc-b947-dae58aeda555 tempest-VolumesListAdminTestJSON-622303885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:44:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1ac5c01a-e95b-48bc-b947-dae58aeda555 tempest-VolumesListAdminTestJSON-622303885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:19 devstack sudo[87783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:44:19 devstack sudo[87783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:19 devstack sudo[87783]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1ac5c01a-e95b-48bc-b947-dae58aeda555 tempest-VolumesListAdminTestJSON-622303885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.561s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:19 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-1ac5c01a-e95b-48bc-b947-dae58aeda555 tempest-VolumesListAdminTestJSON-622303885 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:44:19 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-1ac5c01a-e95b-48bc-b947-dae58aeda555 tempest-VolumesListAdminTestJSON-622303885 None] Deleted volume successfully.
Feb 28 04:44:19 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1ac5c01a-e95b-48bc-b947-dae58aeda555 tempest-VolumesListAdminTestJSON-622303885 None] Lock "cinder-96548735-93d8-4c36-8439-43a704e0e66d-delete_volume" released by "delete_volume" :: held 1.843s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:44:20 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ad20dd9c-c7b3-4cd7-a167-639c8389e7e3 tempest-VolumesListAdminTestJSON-622303885 None] Acquiring lock "cinder-0c61b70e-3d0c-4cd3-9b09-2e5889a634aa-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:44:20 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ad20dd9c-c7b3-4cd7-a167-639c8389e7e3 tempest-VolumesListAdminTestJSON-622303885 None] Lock "cinder-0c61b70e-3d0c-4cd3-9b09-2e5889a634aa-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:44:20 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ad20dd9c-c7b3-4cd7-a167-639c8389e7e3 tempest-VolumesListAdminTestJSON-622303885 None] Acquiring lock "cinder-quobyte-0c61b70e-3d0c-4cd3-9b09-2e5889a634aa" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:44:20 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ad20dd9c-c7b3-4cd7-a167-639c8389e7e3 tempest-VolumesListAdminTestJSON-622303885 None] Lock "cinder-quobyte-0c61b70e-3d0c-4cd3-9b09-2e5889a634aa" acquired by "delete_volume" :: waited 0.010s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:44:20 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[53dd5744-72dd-42b9-a7e3-71193c05042a]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:44:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ad20dd9c-c7b3-4cd7-a167-639c8389e7e3 tempest-VolumesListAdminTestJSON-622303885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0c61b70e-3d0c-4cd3-9b09-2e5889a634aa {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:20 devstack sudo[87787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0c61b70e-3d0c-4cd3-9b09-2e5889a634aa
Feb 28 04:44:20 devstack sudo[87787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:20 devstack sudo[87787]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ad20dd9c-c7b3-4cd7-a167-639c8389e7e3 tempest-VolumesListAdminTestJSON-622303885 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0c61b70e-3d0c-4cd3-9b09-2e5889a634aa" returned: 0 in 0.676s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ad20dd9c-c7b3-4cd7-a167-639c8389e7e3 tempest-VolumesListAdminTestJSON-622303885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0c61b70e-3d0c-4cd3-9b09-2e5889a634aa {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:21 devstack sudo[87792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0c61b70e-3d0c-4cd3-9b09-2e5889a634aa
Feb 28 04:44:21 devstack sudo[87792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:21 devstack sudo[87792]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ad20dd9c-c7b3-4cd7-a167-639c8389e7e3 tempest-VolumesListAdminTestJSON-622303885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0c61b70e-3d0c-4cd3-9b09-2e5889a634aa" returned: 0 in 0.672s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:21 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ad20dd9c-c7b3-4cd7-a167-639c8389e7e3 tempest-VolumesListAdminTestJSON-622303885 None] Lock "cinder-quobyte-0c61b70e-3d0c-4cd3-9b09-2e5889a634aa" released by "delete_volume" :: held 1.381s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:44:21 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-ad20dd9c-c7b3-4cd7-a167-639c8389e7e3 tempest-VolumesListAdminTestJSON-622303885 None] Created reservations ['67d8e2d9-0bf1-41ed-b336-4e1e2856c303', '05a3ec17-25bf-4484-b00e-590bde240a7d', '62be8230-3656-46a8-ae4e-75c35f3eb3da', 'de7e544a-a539-4a3d-bf45-41bde2cb7a6e'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:44:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ad20dd9c-c7b3-4cd7-a167-639c8389e7e3 tempest-VolumesListAdminTestJSON-622303885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:44:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ad20dd9c-c7b3-4cd7-a167-639c8389e7e3 tempest-VolumesListAdminTestJSON-622303885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:44:21 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-ad20dd9c-c7b3-4cd7-a167-639c8389e7e3 tempest-VolumesListAdminTestJSON-622303885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:44:21 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-ad20dd9c-c7b3-4cd7-a167-639c8389e7e3 tempest-VolumesListAdminTestJSON-622303885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:44:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ad20dd9c-c7b3-4cd7-a167-639c8389e7e3 tempest-VolumesListAdminTestJSON-622303885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:44:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ad20dd9c-c7b3-4cd7-a167-639c8389e7e3 tempest-VolumesListAdminTestJSON-622303885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:21 devstack sudo[87795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:44:21 devstack sudo[87795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:22 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-03ff5068-65ef-46e7-a750-2453dfb5b333 tempest-VolumeTypesAccessTest-1602254394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:44:22 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-03ff5068-65ef-46e7-a750-2453dfb5b333 tempest-VolumeTypesAccessTest-1602254394 None] Flow 'volume_create_manager' (33aba61d-d955-4d33-a642-770f50a3d8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:44:22 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-03ff5068-65ef-46e7-a750-2453dfb5b333 tempest-VolumeTypesAccessTest-1602254394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a110f932-5e9f-4b31-8deb-cf8db1c5005c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:22 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-03ff5068-65ef-46e7-a750-2453dfb5b333 tempest-VolumeTypesAccessTest-1602254394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a110f932-5e9f-4b31-8deb-cf8db1c5005c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-311817730',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eb447fa-7355-4f21-8491-c0e22b356978,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e764ac331094b17ab4964c4d02de3de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:44:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:44:22Z,use_quota=True,user_id='8d48be9b4e8c46d68a5d9eecfcb9dbe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e3fb716-6338-45c8-8db4-296e05931e18),volume_type_id=2e3fb716-6338-45c8-8db4-296e05931e18)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:22 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-03ff5068-65ef-46e7-a750-2453dfb5b333 tempest-VolumeTypesAccessTest-1602254394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5688ff27-6cd8-4d70-9890-f3f608990e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:22 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-03ff5068-65ef-46e7-a750-2453dfb5b333 tempest-VolumeTypesAccessTest-1602254394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5688ff27-6cd8-4d70-9890-f3f608990e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:22 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-03ff5068-65ef-46e7-a750-2453dfb5b333 tempest-VolumeTypesAccessTest-1602254394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b8202e-0f9c-4d97-9624-0d78c33514b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:22 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-03ff5068-65ef-46e7-a750-2453dfb5b333 tempest-VolumeTypesAccessTest-1602254394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b8202e-0f9c-4d97-9624-0d78c33514b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eb447fa-7355-4f21-8491-c0e22b356978', 'volume_name': 'volume-9eb447fa-7355-4f21-8491-c0e22b356978', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:22 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-03ff5068-65ef-46e7-a750-2453dfb5b333 tempest-VolumeTypesAccessTest-1602254394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3563566-6a1b-45b0-baab-d1d744bda0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:22 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-03ff5068-65ef-46e7-a750-2453dfb5b333 tempest-VolumeTypesAccessTest-1602254394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3563566-6a1b-45b0-baab-d1d744bda0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:22 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-03ff5068-65ef-46e7-a750-2453dfb5b333 tempest-VolumeTypesAccessTest-1602254394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1031e40-fc39-42db-b566-d8f5191ebadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:22 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-03ff5068-65ef-46e7-a750-2453dfb5b333 tempest-VolumeTypesAccessTest-1602254394 None] Volume 9eb447fa-7355-4f21-8491-c0e22b356978: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eb447fa-7355-4f21-8491-c0e22b356978', 'volume_size': 1}
Feb 28 04:44:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-03ff5068-65ef-46e7-a750-2453dfb5b333 tempest-VolumeTypesAccessTest-1602254394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:44:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-03ff5068-65ef-46e7-a750-2453dfb5b333 tempest-VolumeTypesAccessTest-1602254394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:44:22 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-03ff5068-65ef-46e7-a750-2453dfb5b333 tempest-VolumeTypesAccessTest-1602254394 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-311817730',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eb447fa-7355-4f21-8491-c0e22b356978,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e764ac331094b17ab4964c4d02de3de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:44:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:44:22Z,use_quota=True,user_id='8d48be9b4e8c46d68a5d9eecfcb9dbe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e3fb716-6338-45c8-8db4-296e05931e18),volume_type_id=2e3fb716-6338-45c8-8db4-296e05931e18)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:44:22 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-03ff5068-65ef-46e7-a750-2453dfb5b333 tempest-VolumeTypesAccessTest-1602254394 None] Creating volume 9eb447fa-7355-4f21-8491-c0e22b356978 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:44:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-03ff5068-65ef-46e7-a750-2453dfb5b333 tempest-VolumeTypesAccessTest-1602254394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:44:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-03ff5068-65ef-46e7-a750-2453dfb5b333 tempest-VolumeTypesAccessTest-1602254394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:44:22 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-03ff5068-65ef-46e7-a750-2453dfb5b333 tempest-VolumeTypesAccessTest-1602254394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:44:22 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-03ff5068-65ef-46e7-a750-2453dfb5b333 tempest-VolumeTypesAccessTest-1602254394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:44:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-03ff5068-65ef-46e7-a750-2453dfb5b333 tempest-VolumeTypesAccessTest-1602254394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:44:22 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-03ff5068-65ef-46e7-a750-2453dfb5b333 tempest-VolumeTypesAccessTest-1602254394 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:44:22 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-03ff5068-65ef-46e7-a750-2453dfb5b333 tempest-VolumeTypesAccessTest-1602254394 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:44:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-03ff5068-65ef-46e7-a750-2453dfb5b333 tempest-VolumeTypesAccessTest-1602254394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9eb447fa-7355-4f21-8491-c0e22b356978 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:22 devstack sudo[87797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9eb447fa-7355-4f21-8491-c0e22b356978 1073741824
Feb 28 04:44:22 devstack sudo[87797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:22 devstack sudo[87795]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ad20dd9c-c7b3-4cd7-a167-639c8389e7e3 tempest-VolumesListAdminTestJSON-622303885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.687s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:22 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-ad20dd9c-c7b3-4cd7-a167-639c8389e7e3 tempest-VolumesListAdminTestJSON-622303885 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:44:22 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-ad20dd9c-c7b3-4cd7-a167-639c8389e7e3 tempest-VolumesListAdminTestJSON-622303885 None] Deleted volume successfully.
Feb 28 04:44:22 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ad20dd9c-c7b3-4cd7-a167-639c8389e7e3 tempest-VolumesListAdminTestJSON-622303885 None] Lock "cinder-0c61b70e-3d0c-4cd3-9b09-2e5889a634aa-delete_volume" released by "delete_volume" :: held 2.268s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:44:22 devstack sudo[87797]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-03ff5068-65ef-46e7-a750-2453dfb5b333 tempest-VolumeTypesAccessTest-1602254394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9eb447fa-7355-4f21-8491-c0e22b356978 1073741824" returned: 0 in 0.711s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-03ff5068-65ef-46e7-a750-2453dfb5b333 tempest-VolumeTypesAccessTest-1602254394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9eb447fa-7355-4f21-8491-c0e22b356978 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:23 devstack sudo[87803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9eb447fa-7355-4f21-8491-c0e22b356978
Feb 28 04:44:23 devstack sudo[87803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:23 devstack sudo[87803]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-03ff5068-65ef-46e7-a750-2453dfb5b333 tempest-VolumeTypesAccessTest-1602254394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9eb447fa-7355-4f21-8491-c0e22b356978" returned: 0 in 0.437s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:23 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-03ff5068-65ef-46e7-a750-2453dfb5b333 tempest-VolumeTypesAccessTest-1602254394 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:44:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-03ff5068-65ef-46e7-a750-2453dfb5b333 tempest-VolumeTypesAccessTest-1602254394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:44:23 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-03ff5068-65ef-46e7-a750-2453dfb5b333 tempest-VolumeTypesAccessTest-1602254394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1031e40-fc39-42db-b566-d8f5191ebadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eb447fa-7355-4f21-8491-c0e22b356978', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:23 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-03ff5068-65ef-46e7-a750-2453dfb5b333 tempest-VolumeTypesAccessTest-1602254394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a44d256a-9561-4183-a986-6e54d2e94887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:23 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-03ff5068-65ef-46e7-a750-2453dfb5b333 tempest-VolumeTypesAccessTest-1602254394 None] Volume volume-9eb447fa-7355-4f21-8491-c0e22b356978 (9eb447fa-7355-4f21-8491-c0e22b356978): created successfully
Feb 28 04:44:23 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-03ff5068-65ef-46e7-a750-2453dfb5b333 tempest-VolumeTypesAccessTest-1602254394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a44d256a-9561-4183-a986-6e54d2e94887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:23 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-03ff5068-65ef-46e7-a750-2453dfb5b333 tempest-VolumeTypesAccessTest-1602254394 None] Flow 'volume_create_manager' (33aba61d-d955-4d33-a642-770f50a3d8f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:44:23 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-03ff5068-65ef-46e7-a750-2453dfb5b333 tempest-VolumeTypesAccessTest-1602254394 None] Created volume successfully.
Feb 28 04:44:24 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d7a54cb7-cee1-4a57-b4dc-af55633532ff tempest-VolumeTypesAccessTest-1602254394 None] Acquiring lock "cinder-9eb447fa-7355-4f21-8491-c0e22b356978-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:44:24 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d7a54cb7-cee1-4a57-b4dc-af55633532ff tempest-VolumeTypesAccessTest-1602254394 None] Lock "cinder-9eb447fa-7355-4f21-8491-c0e22b356978-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:44:24 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d7a54cb7-cee1-4a57-b4dc-af55633532ff tempest-VolumeTypesAccessTest-1602254394 None] Acquiring lock "cinder-quobyte-9eb447fa-7355-4f21-8491-c0e22b356978" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:44:24 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d7a54cb7-cee1-4a57-b4dc-af55633532ff tempest-VolumeTypesAccessTest-1602254394 None] Lock "cinder-quobyte-9eb447fa-7355-4f21-8491-c0e22b356978" acquired by "delete_volume" :: waited 0.018s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:44:24 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b398771-616e-4cd2-a67b-b4fd2fe7ce6f]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:44:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d7a54cb7-cee1-4a57-b4dc-af55633532ff tempest-VolumeTypesAccessTest-1602254394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9eb447fa-7355-4f21-8491-c0e22b356978 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:24 devstack sudo[87806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9eb447fa-7355-4f21-8491-c0e22b356978
Feb 28 04:44:24 devstack sudo[87806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:24 devstack cinder-volume[84248]: DEBUG oslo_service.periodic_task [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84248) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 28 04:44:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:44:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:44:24 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:44:24 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:44:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:44:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:24 devstack sudo[87808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:44:24 devstack sudo[87808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:25 devstack sudo[87808]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.442s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:25 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:44:25 devstack sudo[87806]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d7a54cb7-cee1-4a57-b4dc-af55633532ff tempest-VolumeTypesAccessTest-1602254394 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9eb447fa-7355-4f21-8491-c0e22b356978" returned: 0 in 0.664s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d7a54cb7-cee1-4a57-b4dc-af55633532ff tempest-VolumeTypesAccessTest-1602254394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9eb447fa-7355-4f21-8491-c0e22b356978 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:25 devstack sudo[87816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9eb447fa-7355-4f21-8491-c0e22b356978
Feb 28 04:44:25 devstack sudo[87816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:25 devstack sudo[87816]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d7a54cb7-cee1-4a57-b4dc-af55633532ff tempest-VolumeTypesAccessTest-1602254394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9eb447fa-7355-4f21-8491-c0e22b356978" returned: 0 in 0.640s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:25 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d7a54cb7-cee1-4a57-b4dc-af55633532ff tempest-VolumeTypesAccessTest-1602254394 None] Lock "cinder-quobyte-9eb447fa-7355-4f21-8491-c0e22b356978" released by "delete_volume" :: held 1.336s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:44:25 devstack cinder-volume[84248]: WARNING cinder.quota [None req-d7a54cb7-cee1-4a57-b4dc-af55633532ff tempest-VolumeTypesAccessTest-1602254394 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-600000214 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-600000214, it is now deprecated. Please use the default quota class for default quota.
Feb 28 04:44:25 devstack cinder-volume[84248]: WARNING cinder.quota [None req-d7a54cb7-cee1-4a57-b4dc-af55633532ff tempest-VolumeTypesAccessTest-1602254394 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-600000214 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-600000214, it is now deprecated. Please use the default quota class for default quota.
Feb 28 04:44:25 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-d7a54cb7-cee1-4a57-b4dc-af55633532ff tempest-VolumeTypesAccessTest-1602254394 None] Created reservations ['faae7f99-6e6b-4877-92c0-f19d0702d5f6', 'e36d7d50-6594-4076-a8df-364feb9efb26', 'e06cba51-41aa-4f00-a5eb-e2f00d81156c', 'c27e3d4f-48a8-47c6-9b41-db250253ba54'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:44:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d7a54cb7-cee1-4a57-b4dc-af55633532ff tempest-VolumeTypesAccessTest-1602254394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:44:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d7a54cb7-cee1-4a57-b4dc-af55633532ff tempest-VolumeTypesAccessTest-1602254394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:44:25 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-d7a54cb7-cee1-4a57-b4dc-af55633532ff tempest-VolumeTypesAccessTest-1602254394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:44:25 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-d7a54cb7-cee1-4a57-b4dc-af55633532ff tempest-VolumeTypesAccessTest-1602254394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:44:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d7a54cb7-cee1-4a57-b4dc-af55633532ff tempest-VolumeTypesAccessTest-1602254394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:44:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d7a54cb7-cee1-4a57-b4dc-af55633532ff tempest-VolumeTypesAccessTest-1602254394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:25 devstack sudo[87820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:44:25 devstack sudo[87820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:26 devstack sudo[87820]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d7a54cb7-cee1-4a57-b4dc-af55633532ff tempest-VolumeTypesAccessTest-1602254394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.646s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:26 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-d7a54cb7-cee1-4a57-b4dc-af55633532ff tempest-VolumeTypesAccessTest-1602254394 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:44:26 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-d7a54cb7-cee1-4a57-b4dc-af55633532ff tempest-VolumeTypesAccessTest-1602254394 None] Deleted volume successfully.
Feb 28 04:44:26 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d7a54cb7-cee1-4a57-b4dc-af55633532ff tempest-VolumeTypesAccessTest-1602254394 None] Lock "cinder-9eb447fa-7355-4f21-8491-c0e22b356978-delete_volume" released by "delete_volume" :: held 2.177s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:44:28 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-560dfb71-8534-4904-bb9e-b8bcc22d0780 tempest-SnapshotMetadataTestJSON-1965862813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:44:28 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-560dfb71-8534-4904-bb9e-b8bcc22d0780 tempest-SnapshotMetadataTestJSON-1965862813 None] Flow 'volume_create_manager' (69745dac-8492-405f-bb8a-685a45a8942d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:44:28 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-560dfb71-8534-4904-bb9e-b8bcc22d0780 tempest-SnapshotMetadataTestJSON-1965862813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f485b18-46d0-472c-8028-6088eadc8508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:28 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-560dfb71-8534-4904-bb9e-b8bcc22d0780 tempest-SnapshotMetadataTestJSON-1965862813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f485b18-46d0-472c-8028-6088eadc8508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1521836753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2503d9a-c2bd-449f-905d-260373eb7051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76b4acd02b5e4d37afd3838fecf37af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:44:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:44:29Z,use_quota=True,user_id='76f6f928e829481bb40db4236624739b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:28 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-560dfb71-8534-4904-bb9e-b8bcc22d0780 tempest-SnapshotMetadataTestJSON-1965862813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea2260c4-d8fb-4601-8bfb-fabbe74a8b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:28 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-560dfb71-8534-4904-bb9e-b8bcc22d0780 tempest-SnapshotMetadataTestJSON-1965862813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea2260c4-d8fb-4601-8bfb-fabbe74a8b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:28 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-560dfb71-8534-4904-bb9e-b8bcc22d0780 tempest-SnapshotMetadataTestJSON-1965862813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beee82f2-e973-404b-b5bd-af9944b9ff63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:28 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-560dfb71-8534-4904-bb9e-b8bcc22d0780 tempest-SnapshotMetadataTestJSON-1965862813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beee82f2-e973-404b-b5bd-af9944b9ff63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2503d9a-c2bd-449f-905d-260373eb7051', 'volume_name': 'volume-f2503d9a-c2bd-449f-905d-260373eb7051', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:28 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-560dfb71-8534-4904-bb9e-b8bcc22d0780 tempest-SnapshotMetadataTestJSON-1965862813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56598b84-0ff8-4b15-a910-35a22748f587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:28 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-560dfb71-8534-4904-bb9e-b8bcc22d0780 tempest-SnapshotMetadataTestJSON-1965862813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56598b84-0ff8-4b15-a910-35a22748f587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:28 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-560dfb71-8534-4904-bb9e-b8bcc22d0780 tempest-SnapshotMetadataTestJSON-1965862813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87e96092-42d5-4416-8c76-b37f155add7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:28 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-560dfb71-8534-4904-bb9e-b8bcc22d0780 tempest-SnapshotMetadataTestJSON-1965862813 None] Volume f2503d9a-c2bd-449f-905d-260373eb7051: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2503d9a-c2bd-449f-905d-260373eb7051', 'volume_size': 1}
Feb 28 04:44:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-560dfb71-8534-4904-bb9e-b8bcc22d0780 tempest-SnapshotMetadataTestJSON-1965862813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:44:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-560dfb71-8534-4904-bb9e-b8bcc22d0780 tempest-SnapshotMetadataTestJSON-1965862813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:44:28 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-560dfb71-8534-4904-bb9e-b8bcc22d0780 tempest-SnapshotMetadataTestJSON-1965862813 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1521836753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2503d9a-c2bd-449f-905d-260373eb7051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76b4acd02b5e4d37afd3838fecf37af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:44:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:44:29Z,use_quota=True,user_id='76f6f928e829481bb40db4236624739b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:44:28 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-560dfb71-8534-4904-bb9e-b8bcc22d0780 tempest-SnapshotMetadataTestJSON-1965862813 None] Creating volume f2503d9a-c2bd-449f-905d-260373eb7051 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:44:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-560dfb71-8534-4904-bb9e-b8bcc22d0780 tempest-SnapshotMetadataTestJSON-1965862813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:44:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-560dfb71-8534-4904-bb9e-b8bcc22d0780 tempest-SnapshotMetadataTestJSON-1965862813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:44:28 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-560dfb71-8534-4904-bb9e-b8bcc22d0780 tempest-SnapshotMetadataTestJSON-1965862813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:44:28 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-560dfb71-8534-4904-bb9e-b8bcc22d0780 tempest-SnapshotMetadataTestJSON-1965862813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:44:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-560dfb71-8534-4904-bb9e-b8bcc22d0780 tempest-SnapshotMetadataTestJSON-1965862813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:44:28 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-560dfb71-8534-4904-bb9e-b8bcc22d0780 tempest-SnapshotMetadataTestJSON-1965862813 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:44:28 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-560dfb71-8534-4904-bb9e-b8bcc22d0780 tempest-SnapshotMetadataTestJSON-1965862813 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:44:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-560dfb71-8534-4904-bb9e-b8bcc22d0780 tempest-SnapshotMetadataTestJSON-1965862813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:28 devstack sudo[87823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051 1073741824
Feb 28 04:44:28 devstack sudo[87823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:29 devstack sudo[87823]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-560dfb71-8534-4904-bb9e-b8bcc22d0780 tempest-SnapshotMetadataTestJSON-1965862813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051 1073741824" returned: 0 in 0.692s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-560dfb71-8534-4904-bb9e-b8bcc22d0780 tempest-SnapshotMetadataTestJSON-1965862813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:29 devstack sudo[87828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051
Feb 28 04:44:29 devstack sudo[87828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:30 devstack sudo[87828]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-560dfb71-8534-4904-bb9e-b8bcc22d0780 tempest-SnapshotMetadataTestJSON-1965862813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051" returned: 0 in 0.607s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:30 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-560dfb71-8534-4904-bb9e-b8bcc22d0780 tempest-SnapshotMetadataTestJSON-1965862813 None] <== create_volume: return (1328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:44:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-560dfb71-8534-4904-bb9e-b8bcc22d0780 tempest-SnapshotMetadataTestJSON-1965862813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:44:30 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-560dfb71-8534-4904-bb9e-b8bcc22d0780 tempest-SnapshotMetadataTestJSON-1965862813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87e96092-42d5-4416-8c76-b37f155add7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2503d9a-c2bd-449f-905d-260373eb7051', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:30 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-560dfb71-8534-4904-bb9e-b8bcc22d0780 tempest-SnapshotMetadataTestJSON-1965862813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dbd9c8b-e6e8-4f9b-b0d3-0f4130434f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:30 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-560dfb71-8534-4904-bb9e-b8bcc22d0780 tempest-SnapshotMetadataTestJSON-1965862813 None] Volume volume-f2503d9a-c2bd-449f-905d-260373eb7051 (f2503d9a-c2bd-449f-905d-260373eb7051): created successfully
Feb 28 04:44:30 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-560dfb71-8534-4904-bb9e-b8bcc22d0780 tempest-SnapshotMetadataTestJSON-1965862813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dbd9c8b-e6e8-4f9b-b0d3-0f4130434f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:30 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-560dfb71-8534-4904-bb9e-b8bcc22d0780 tempest-SnapshotMetadataTestJSON-1965862813 None] Flow 'volume_create_manager' (69745dac-8492-405f-bb8a-685a45a8942d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:44:30 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-560dfb71-8534-4904-bb9e-b8bcc22d0780 tempest-SnapshotMetadataTestJSON-1965862813 None] Created volume successfully.
Feb 28 04:44:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b53ed5ce-f525-46a0-87dd-1bb2251c0f12 tempest-SnapshotMetadataTestJSON-1965862813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:44:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b53ed5ce-f525-46a0-87dd-1bb2251c0f12 tempest-SnapshotMetadataTestJSON-1965862813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:44:31 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-b53ed5ce-f525-46a0-87dd-1bb2251c0f12 tempest-SnapshotMetadataTestJSON-1965862813 None] Creating offline snapshot d1530885-57fe-4fc0-891f-baafee86fa55 of volume f2503d9a-c2bd-449f-905d-260373eb7051 {{(pid=84248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 04:44:31 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ab5d31-d134-4897-98eb-1ebf9af7f6db]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:44:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b53ed5ce-f525-46a0-87dd-1bb2251c0f12 tempest-SnapshotMetadataTestJSON-1965862813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:31 devstack sudo[87837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051
Feb 28 04:44:31 devstack sudo[87837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:31 devstack sudo[87837]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b53ed5ce-f525-46a0-87dd-1bb2251c0f12 tempest-SnapshotMetadataTestJSON-1965862813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051" returned: 0 in 0.656s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b53ed5ce-f525-46a0-87dd-1bb2251c0f12 tempest-SnapshotMetadataTestJSON-1965862813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051.d1530885-57fe-4fc0-891f-baafee86fa55 1G {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:31 devstack sudo[87857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051.d1530885-57fe-4fc0-891f-baafee86fa55 1G
Feb 28 04:44:31 devstack sudo[87857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:32 devstack sudo[87857]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b53ed5ce-f525-46a0-87dd-1bb2251c0f12 tempest-SnapshotMetadataTestJSON-1965862813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051.d1530885-57fe-4fc0-891f-baafee86fa55 1G" returned: 0 in 0.580s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b53ed5ce-f525-46a0-87dd-1bb2251c0f12 tempest-SnapshotMetadataTestJSON-1965862813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2503d9a-c2bd-449f-905d-260373eb7051 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051.d1530885-57fe-4fc0-891f-baafee86fa55 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:32 devstack sudo[87862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2503d9a-c2bd-449f-905d-260373eb7051 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051.d1530885-57fe-4fc0-891f-baafee86fa55
Feb 28 04:44:32 devstack sudo[87862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:32 devstack sudo[87862]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b53ed5ce-f525-46a0-87dd-1bb2251c0f12 tempest-SnapshotMetadataTestJSON-1965862813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2503d9a-c2bd-449f-905d-260373eb7051 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051.d1530885-57fe-4fc0-891f-baafee86fa55" returned: 0 in 0.514s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:32 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-b53ed5ce-f525-46a0-87dd-1bb2251c0f12 tempest-SnapshotMetadataTestJSON-1965862813 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051.d1530885-57fe-4fc0-891f-baafee86fa55 is being set with open permissions: ugo+rw
Feb 28 04:44:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b53ed5ce-f525-46a0-87dd-1bb2251c0f12 tempest-SnapshotMetadataTestJSON-1965862813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051.d1530885-57fe-4fc0-891f-baafee86fa55 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:32 devstack sudo[87867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051.d1530885-57fe-4fc0-891f-baafee86fa55
Feb 28 04:44:32 devstack sudo[87867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:32 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-e380fb69-dac9-446e-87bc-87907b3b5357 tempest-VolumesMetadataTest-1832705401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:44:32 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e380fb69-dac9-446e-87bc-87907b3b5357 tempest-VolumesMetadataTest-1832705401 None] Flow 'volume_create_manager' (0f137700-2be2-43fb-ad19-e837c9eafb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:44:32 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e380fb69-dac9-446e-87bc-87907b3b5357 tempest-VolumesMetadataTest-1832705401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (118e4c37-c1df-4add-be98-cbf465ea01dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:33 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e380fb69-dac9-446e-87bc-87907b3b5357 tempest-VolumesMetadataTest-1832705401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (118e4c37-c1df-4add-be98-cbf465ea01dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-566036486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9934c258-b80b-42cb-9677-5dc33067395e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba9cdd487b39490faa0591fc47c93f14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:44:33Z,use_quota=True,user_id='d7f12a6e48124732ab6cdbc728c2b83f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:33 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e380fb69-dac9-446e-87bc-87907b3b5357 tempest-VolumesMetadataTest-1832705401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c036366-7af4-42aa-9d2c-669027a42bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:33 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e380fb69-dac9-446e-87bc-87907b3b5357 tempest-VolumesMetadataTest-1832705401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c036366-7af4-42aa-9d2c-669027a42bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:33 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e380fb69-dac9-446e-87bc-87907b3b5357 tempest-VolumesMetadataTest-1832705401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b5999dc-b47c-452a-806f-b848cf49e420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:33 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e380fb69-dac9-446e-87bc-87907b3b5357 tempest-VolumesMetadataTest-1832705401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b5999dc-b47c-452a-806f-b848cf49e420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9934c258-b80b-42cb-9677-5dc33067395e', 'volume_name': 'volume-9934c258-b80b-42cb-9677-5dc33067395e', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:33 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e380fb69-dac9-446e-87bc-87907b3b5357 tempest-VolumesMetadataTest-1832705401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01e0dafd-5805-4397-9217-f15ff217069d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:33 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e380fb69-dac9-446e-87bc-87907b3b5357 tempest-VolumesMetadataTest-1832705401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01e0dafd-5805-4397-9217-f15ff217069d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:33 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e380fb69-dac9-446e-87bc-87907b3b5357 tempest-VolumesMetadataTest-1832705401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4901db9-51c9-45bc-848d-c97d5c038fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:33 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-e380fb69-dac9-446e-87bc-87907b3b5357 tempest-VolumesMetadataTest-1832705401 None] Volume 9934c258-b80b-42cb-9677-5dc33067395e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9934c258-b80b-42cb-9677-5dc33067395e', 'volume_size': 1}
Feb 28 04:44:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e380fb69-dac9-446e-87bc-87907b3b5357 tempest-VolumesMetadataTest-1832705401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:44:33 devstack sudo[87867]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b53ed5ce-f525-46a0-87dd-1bb2251c0f12 tempest-SnapshotMetadataTestJSON-1965862813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051.d1530885-57fe-4fc0-891f-baafee86fa55" returned: 0 in 0.432s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b53ed5ce-f525-46a0-87dd-1bb2251c0f12 tempest-SnapshotMetadataTestJSON-1965862813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:33 devstack sudo[87870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051.info
Feb 28 04:44:33 devstack sudo[87870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:33 devstack sudo[87870]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b53ed5ce-f525-46a0-87dd-1bb2251c0f12 tempest-SnapshotMetadataTestJSON-1965862813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051.info" returned: 0 in 0.415s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:33 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-b53ed5ce-f525-46a0-87dd-1bb2251c0f12 tempest-SnapshotMetadataTestJSON-1965862813 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051.info is being set with open permissions: ugo+rw
Feb 28 04:44:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b53ed5ce-f525-46a0-87dd-1bb2251c0f12 tempest-SnapshotMetadataTestJSON-1965862813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:33 devstack sudo[87873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051.info
Feb 28 04:44:33 devstack sudo[87873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:34 devstack sudo[87873]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b53ed5ce-f525-46a0-87dd-1bb2251c0f12 tempest-SnapshotMetadataTestJSON-1965862813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051.info" returned: 0 in 0.419s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b53ed5ce-f525-46a0-87dd-1bb2251c0f12 tempest-SnapshotMetadataTestJSON-1965862813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.091s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:44:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e380fb69-dac9-446e-87bc-87907b3b5357 tempest-VolumesMetadataTest-1832705401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.105s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:44:34 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-e380fb69-dac9-446e-87bc-87907b3b5357 tempest-VolumesMetadataTest-1832705401 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-566036486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9934c258-b80b-42cb-9677-5dc33067395e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba9cdd487b39490faa0591fc47c93f14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:44:33Z,use_quota=True,user_id='d7f12a6e48124732ab6cdbc728c2b83f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:44:34 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-e380fb69-dac9-446e-87bc-87907b3b5357 tempest-VolumesMetadataTest-1832705401 None] Creating volume 9934c258-b80b-42cb-9677-5dc33067395e {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:44:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e380fb69-dac9-446e-87bc-87907b3b5357 tempest-VolumesMetadataTest-1832705401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:44:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e380fb69-dac9-446e-87bc-87907b3b5357 tempest-VolumesMetadataTest-1832705401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:44:34 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-e380fb69-dac9-446e-87bc-87907b3b5357 tempest-VolumesMetadataTest-1832705401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:44:34 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-e380fb69-dac9-446e-87bc-87907b3b5357 tempest-VolumesMetadataTest-1832705401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:44:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e380fb69-dac9-446e-87bc-87907b3b5357 tempest-VolumesMetadataTest-1832705401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:44:34 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-e380fb69-dac9-446e-87bc-87907b3b5357 tempest-VolumesMetadataTest-1832705401 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:44:34 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-e380fb69-dac9-446e-87bc-87907b3b5357 tempest-VolumesMetadataTest-1832705401 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:44:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e380fb69-dac9-446e-87bc-87907b3b5357 tempest-VolumesMetadataTest-1832705401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9934c258-b80b-42cb-9677-5dc33067395e 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:34 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-b53ed5ce-f525-46a0-87dd-1bb2251c0f12 tempest-SnapshotMetadataTestJSON-1965862813 None] Create snapshot completed successfully
Feb 28 04:44:34 devstack sudo[87876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9934c258-b80b-42cb-9677-5dc33067395e 1073741824
Feb 28 04:44:34 devstack sudo[87876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:34 devstack sudo[87876]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e380fb69-dac9-446e-87bc-87907b3b5357 tempest-VolumesMetadataTest-1832705401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9934c258-b80b-42cb-9677-5dc33067395e 1073741824" returned: 0 in 0.466s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e380fb69-dac9-446e-87bc-87907b3b5357 tempest-VolumesMetadataTest-1832705401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9934c258-b80b-42cb-9677-5dc33067395e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:34 devstack sudo[87881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9934c258-b80b-42cb-9677-5dc33067395e
Feb 28 04:44:34 devstack sudo[87881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:35 devstack sudo[87881]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e380fb69-dac9-446e-87bc-87907b3b5357 tempest-VolumesMetadataTest-1832705401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9934c258-b80b-42cb-9677-5dc33067395e" returned: 0 in 0.439s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:35 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-e380fb69-dac9-446e-87bc-87907b3b5357 tempest-VolumesMetadataTest-1832705401 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:44:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e380fb69-dac9-446e-87bc-87907b3b5357 tempest-VolumesMetadataTest-1832705401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:44:35 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e380fb69-dac9-446e-87bc-87907b3b5357 tempest-VolumesMetadataTest-1832705401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4901db9-51c9-45bc-848d-c97d5c038fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9934c258-b80b-42cb-9677-5dc33067395e', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:35 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e380fb69-dac9-446e-87bc-87907b3b5357 tempest-VolumesMetadataTest-1832705401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e854eef-58ae-4b3e-a1f9-706d0cfd3529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:35 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-e380fb69-dac9-446e-87bc-87907b3b5357 tempest-VolumesMetadataTest-1832705401 None] Volume volume-9934c258-b80b-42cb-9677-5dc33067395e (9934c258-b80b-42cb-9677-5dc33067395e): created successfully
Feb 28 04:44:35 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e380fb69-dac9-446e-87bc-87907b3b5357 tempest-VolumesMetadataTest-1832705401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e854eef-58ae-4b3e-a1f9-706d0cfd3529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:35 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e380fb69-dac9-446e-87bc-87907b3b5357 tempest-VolumesMetadataTest-1832705401 None] Flow 'volume_create_manager' (0f137700-2be2-43fb-ad19-e837c9eafb1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:44:35 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-e380fb69-dac9-446e-87bc-87907b3b5357 tempest-VolumesMetadataTest-1832705401 None] Created volume successfully.
Feb 28 04:44:35 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1764afc6-3bc0-44c0-b370-8ba1c1b48158 tempest-SnapshotMetadataTestJSON-1965862813 None] Acquiring lock "cinder-d1530885-57fe-4fc0-891f-baafee86fa55-delete_snapshot" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:44:35 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1764afc6-3bc0-44c0-b370-8ba1c1b48158 tempest-SnapshotMetadataTestJSON-1965862813 None] Lock "cinder-d1530885-57fe-4fc0-891f-baafee86fa55-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:44:35 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1764afc6-3bc0-44c0-b370-8ba1c1b48158 tempest-SnapshotMetadataTestJSON-1965862813 None] Acquiring lock "cinder-quobyte-f2503d9a-c2bd-449f-905d-260373eb7051" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:44:35 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1764afc6-3bc0-44c0-b370-8ba1c1b48158 tempest-SnapshotMetadataTestJSON-1965862813 None] Lock "cinder-quobyte-f2503d9a-c2bd-449f-905d-260373eb7051" acquired by "delete_snapshot" :: waited 0.006s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:44:35 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1764afc6-3bc0-44c0-b370-8ba1c1b48158 tempest-SnapshotMetadataTestJSON-1965862813 None] Acquiring lock "cinder-quobyte-d1530885-57fe-4fc0-891f-baafee86fa55" by "_delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:44:35 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1764afc6-3bc0-44c0-b370-8ba1c1b48158 tempest-SnapshotMetadataTestJSON-1965862813 None] Lock "cinder-quobyte-d1530885-57fe-4fc0-891f-baafee86fa55" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:44:35 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-1764afc6-3bc0-44c0-b370-8ba1c1b48158 tempest-SnapshotMetadataTestJSON-1965862813 None] Deleting offline snapshot d1530885-57fe-4fc0-891f-baafee86fa55 of volume f2503d9a-c2bd-449f-905d-260373eb7051 {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 04:44:35 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-1764afc6-3bc0-44c0-b370-8ba1c1b48158 tempest-SnapshotMetadataTestJSON-1965862813 None] snapshot_file for this snap is: volume-f2503d9a-c2bd-449f-905d-260373eb7051.d1530885-57fe-4fc0-891f-baafee86fa55 {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 04:44:35 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[06de67c7-746f-4241-81d4-e750ae3af9b4]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:44:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1764afc6-3bc0-44c0-b370-8ba1c1b48158 tempest-SnapshotMetadataTestJSON-1965862813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051.d1530885-57fe-4fc0-891f-baafee86fa55 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:35 devstack sudo[87887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051.d1530885-57fe-4fc0-891f-baafee86fa55
Feb 28 04:44:35 devstack sudo[87887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:36 devstack sudo[87887]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1764afc6-3bc0-44c0-b370-8ba1c1b48158 tempest-SnapshotMetadataTestJSON-1965862813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051.d1530885-57fe-4fc0-891f-baafee86fa55" returned: 0 in 0.497s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:36 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-1764afc6-3bc0-44c0-b370-8ba1c1b48158 tempest-SnapshotMetadataTestJSON-1965862813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2503d9a-c2bd-449f-905d-260373eb7051(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:44:36 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1d5d68-d6e0-4f17-8b5c-aea356d19858]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:44:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1764afc6-3bc0-44c0-b370-8ba1c1b48158 tempest-SnapshotMetadataTestJSON-1965862813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:36 devstack sudo[87905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051
Feb 28 04:44:36 devstack sudo[87905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:37 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-2f7d3ad7-1a17-4e12-ab8d-617c264e2404 tempest-VolumesMetadataTest-1832705401 None] Acquiring lock "cinder-9934c258-b80b-42cb-9677-5dc33067395e-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:44:37 devstack sudo[87905]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:37 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-2f7d3ad7-1a17-4e12-ab8d-617c264e2404 tempest-VolumesMetadataTest-1832705401 None] Lock "cinder-9934c258-b80b-42cb-9677-5dc33067395e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:44:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1764afc6-3bc0-44c0-b370-8ba1c1b48158 tempest-SnapshotMetadataTestJSON-1965862813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051" returned: 0 in 1.027s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1764afc6-3bc0-44c0-b370-8ba1c1b48158 tempest-SnapshotMetadataTestJSON-1965862813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051.d1530885-57fe-4fc0-891f-baafee86fa55 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:37 devstack sudo[87924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051.d1530885-57fe-4fc0-891f-baafee86fa55
Feb 28 04:44:37 devstack sudo[87924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:37 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-2f7d3ad7-1a17-4e12-ab8d-617c264e2404 tempest-VolumesMetadataTest-1832705401 None] Acquiring lock "cinder-quobyte-9934c258-b80b-42cb-9677-5dc33067395e" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:44:37 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-2f7d3ad7-1a17-4e12-ab8d-617c264e2404 tempest-VolumesMetadataTest-1832705401 None] Lock "cinder-quobyte-9934c258-b80b-42cb-9677-5dc33067395e" acquired by "delete_volume" :: waited 0.012s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:44:37 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c820f00-5358-4928-8d71-1fe46dba82a7]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:44:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-2f7d3ad7-1a17-4e12-ab8d-617c264e2404 tempest-VolumesMetadataTest-1832705401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9934c258-b80b-42cb-9677-5dc33067395e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:37 devstack sudo[87926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9934c258-b80b-42cb-9677-5dc33067395e
Feb 28 04:44:37 devstack sudo[87926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:38 devstack sudo[87924]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:38 devstack sudo[87926]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-2f7d3ad7-1a17-4e12-ab8d-617c264e2404 tempest-VolumesMetadataTest-1832705401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9934c258-b80b-42cb-9677-5dc33067395e" returned: 0 in 0.891s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1764afc6-3bc0-44c0-b370-8ba1c1b48158 tempest-SnapshotMetadataTestJSON-1965862813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051.d1530885-57fe-4fc0-891f-baafee86fa55" returned: 0 in 0.961s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-2f7d3ad7-1a17-4e12-ab8d-617c264e2404 tempest-VolumesMetadataTest-1832705401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9934c258-b80b-42cb-9677-5dc33067395e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1764afc6-3bc0-44c0-b370-8ba1c1b48158 tempest-SnapshotMetadataTestJSON-1965862813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051.d1530885-57fe-4fc0-891f-baafee86fa55 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:38 devstack sudo[87939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9934c258-b80b-42cb-9677-5dc33067395e
Feb 28 04:44:38 devstack sudo[87939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:38 devstack sudo[87940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051.d1530885-57fe-4fc0-891f-baafee86fa55
Feb 28 04:44:38 devstack sudo[87940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:38 devstack sudo[87939]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-2f7d3ad7-1a17-4e12-ab8d-617c264e2404 tempest-VolumesMetadataTest-1832705401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9934c258-b80b-42cb-9677-5dc33067395e" returned: 0 in 0.470s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:38 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-2f7d3ad7-1a17-4e12-ab8d-617c264e2404 tempest-VolumesMetadataTest-1832705401 None] Lock "cinder-quobyte-9934c258-b80b-42cb-9677-5dc33067395e" released by "delete_volume" :: held 1.390s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:44:38 devstack sudo[87940]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1764afc6-3bc0-44c0-b370-8ba1c1b48158 tempest-SnapshotMetadataTestJSON-1965862813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051.d1530885-57fe-4fc0-891f-baafee86fa55" returned: 0 in 0.498s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:38 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-2f7d3ad7-1a17-4e12-ab8d-617c264e2404 tempest-VolumesMetadataTest-1832705401 None] Created reservations ['31c2eb9a-0851-4102-82c7-70c46246e8e9', '01504a38-4524-4061-9c33-80d3d392617f', 'a52a144d-47b5-4429-96d3-b1e74946f681', '3aa61109-fa4b-47a5-8550-e6e3ca324a69'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:44:38 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1764afc6-3bc0-44c0-b370-8ba1c1b48158 tempest-SnapshotMetadataTestJSON-1965862813 None] Lock "cinder-quobyte-d1530885-57fe-4fc0-891f-baafee86fa55" released by "_delete_snapshot" :: held 3.118s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:44:38 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1764afc6-3bc0-44c0-b370-8ba1c1b48158 tempest-SnapshotMetadataTestJSON-1965862813 None] Lock "cinder-quobyte-f2503d9a-c2bd-449f-905d-260373eb7051" released by "delete_snapshot" :: held 3.134s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:44:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-2f7d3ad7-1a17-4e12-ab8d-617c264e2404 tempest-VolumesMetadataTest-1832705401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:44:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-2f7d3ad7-1a17-4e12-ab8d-617c264e2404 tempest-VolumesMetadataTest-1832705401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:44:38 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-2f7d3ad7-1a17-4e12-ab8d-617c264e2404 tempest-VolumesMetadataTest-1832705401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:44:38 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-2f7d3ad7-1a17-4e12-ab8d-617c264e2404 tempest-VolumesMetadataTest-1832705401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:44:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-2f7d3ad7-1a17-4e12-ab8d-617c264e2404 tempest-VolumesMetadataTest-1832705401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:44:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-2f7d3ad7-1a17-4e12-ab8d-617c264e2404 tempest-VolumesMetadataTest-1832705401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:38 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-1764afc6-3bc0-44c0-b370-8ba1c1b48158 tempest-SnapshotMetadataTestJSON-1965862813 None] Created reservations ['13902af5-d0ef-4293-8cdf-daa75722c5ad', '35e98447-0c98-435d-843c-137e9ec50d79', '55ae1971-b1fe-4613-86d0-a49e93b78202', 'f63c190a-9a9c-4973-8e32-87331e59f4ec'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:44:38 devstack sudo[87957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:44:38 devstack sudo[87957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:38 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-1764afc6-3bc0-44c0-b370-8ba1c1b48158 tempest-SnapshotMetadataTestJSON-1965862813 None] Delete snapshot completed successfully.
Feb 28 04:44:38 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1764afc6-3bc0-44c0-b370-8ba1c1b48158 tempest-SnapshotMetadataTestJSON-1965862813 None] Lock "cinder-d1530885-57fe-4fc0-891f-baafee86fa55-delete_snapshot" released by "delete_snapshot" :: held 3.269s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:44:39 devstack sudo[87957]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-2f7d3ad7-1a17-4e12-ab8d-617c264e2404 tempest-VolumesMetadataTest-1832705401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.449s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:39 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-2f7d3ad7-1a17-4e12-ab8d-617c264e2404 tempest-VolumesMetadataTest-1832705401 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:44:39 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-2f7d3ad7-1a17-4e12-ab8d-617c264e2404 tempest-VolumesMetadataTest-1832705401 None] Deleted volume successfully.
Feb 28 04:44:39 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-2f7d3ad7-1a17-4e12-ab8d-617c264e2404 tempest-VolumesMetadataTest-1832705401 None] Lock "cinder-9934c258-b80b-42cb-9677-5dc33067395e-delete_volume" released by "delete_volume" :: held 2.068s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:44:40 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-62930013-4b43-4a65-ade5-f797000a0e32 tempest-SnapshotMetadataTestJSON-1965862813 None] Acquiring lock "cinder-f2503d9a-c2bd-449f-905d-260373eb7051-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:44:40 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-62930013-4b43-4a65-ade5-f797000a0e32 tempest-SnapshotMetadataTestJSON-1965862813 None] Lock "cinder-f2503d9a-c2bd-449f-905d-260373eb7051-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:44:40 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-62930013-4b43-4a65-ade5-f797000a0e32 tempest-SnapshotMetadataTestJSON-1965862813 None] Acquiring lock "cinder-quobyte-f2503d9a-c2bd-449f-905d-260373eb7051" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:44:40 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-62930013-4b43-4a65-ade5-f797000a0e32 tempest-SnapshotMetadataTestJSON-1965862813 None] Lock "cinder-quobyte-f2503d9a-c2bd-449f-905d-260373eb7051" acquired by "delete_volume" :: waited 0.013s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:44:40 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[201aedc4-647b-414c-9748-941ad1ef5116]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:44:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-62930013-4b43-4a65-ade5-f797000a0e32 tempest-SnapshotMetadataTestJSON-1965862813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:40 devstack sudo[87963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051
Feb 28 04:44:40 devstack sudo[87963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:40 devstack sudo[87963]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-62930013-4b43-4a65-ade5-f797000a0e32 tempest-SnapshotMetadataTestJSON-1965862813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051" returned: 0 in 0.677s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-62930013-4b43-4a65-ade5-f797000a0e32 tempest-SnapshotMetadataTestJSON-1965862813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:40 devstack sudo[87968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051
Feb 28 04:44:40 devstack sudo[87968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:41 devstack sudo[87968]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-62930013-4b43-4a65-ade5-f797000a0e32 tempest-SnapshotMetadataTestJSON-1965862813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f2503d9a-c2bd-449f-905d-260373eb7051" returned: 0 in 0.502s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:41 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-62930013-4b43-4a65-ade5-f797000a0e32 tempest-SnapshotMetadataTestJSON-1965862813 None] Lock "cinder-quobyte-f2503d9a-c2bd-449f-905d-260373eb7051" released by "delete_volume" :: held 1.317s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:44:41 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-62930013-4b43-4a65-ade5-f797000a0e32 tempest-SnapshotMetadataTestJSON-1965862813 None] Created reservations ['f4f111d6-41e6-437a-9748-c435f7d5412a', '053c5087-2f4c-4a18-8f32-13bfdb7a275c', '5edf8dd7-e386-42d1-ba7d-9a07c44edbec', '5ed5b6e5-3abd-4705-a8db-77fa6e9c23c8'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:44:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-62930013-4b43-4a65-ade5-f797000a0e32 tempest-SnapshotMetadataTestJSON-1965862813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:44:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-62930013-4b43-4a65-ade5-f797000a0e32 tempest-SnapshotMetadataTestJSON-1965862813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:44:41 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-62930013-4b43-4a65-ade5-f797000a0e32 tempest-SnapshotMetadataTestJSON-1965862813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:44:41 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-62930013-4b43-4a65-ade5-f797000a0e32 tempest-SnapshotMetadataTestJSON-1965862813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:44:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-62930013-4b43-4a65-ade5-f797000a0e32 tempest-SnapshotMetadataTestJSON-1965862813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:44:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-62930013-4b43-4a65-ade5-f797000a0e32 tempest-SnapshotMetadataTestJSON-1965862813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:41 devstack sudo[87971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:44:41 devstack sudo[87971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:42 devstack sudo[87971]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:42 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-62930013-4b43-4a65-ade5-f797000a0e32 tempest-SnapshotMetadataTestJSON-1965862813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.515s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:42 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-62930013-4b43-4a65-ade5-f797000a0e32 tempest-SnapshotMetadataTestJSON-1965862813 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:44:42 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-62930013-4b43-4a65-ade5-f797000a0e32 tempest-SnapshotMetadataTestJSON-1965862813 None] Deleted volume successfully.
Feb 28 04:44:42 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-62930013-4b43-4a65-ade5-f797000a0e32 tempest-SnapshotMetadataTestJSON-1965862813 None] Lock "cinder-f2503d9a-c2bd-449f-905d-260373eb7051-delete_volume" released by "delete_volume" :: held 2.029s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:44:42 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-10f41e94-c93a-4fd5-bfac-8e4ff77ecb26 tempest-VolumesTransfersV357Test-1334344176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:44:42 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-10f41e94-c93a-4fd5-bfac-8e4ff77ecb26 tempest-VolumesTransfersV357Test-1334344176 None] Flow 'volume_create_manager' (89589257-7fa0-42f3-95ff-28a4777784eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:44:42 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-10f41e94-c93a-4fd5-bfac-8e4ff77ecb26 tempest-VolumesTransfersV357Test-1334344176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d09cb63-3a0f-4acf-8251-1657a702bb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:42 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-10f41e94-c93a-4fd5-bfac-8e4ff77ecb26 tempest-VolumesTransfersV357Test-1334344176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d09cb63-3a0f-4acf-8251-1657a702bb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1927522087',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a11cc141-9abe-49bd-80ed-c765d5d97f63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b7cd29fa47840d5b9a65abb05c1ca72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:44:42Z,use_quota=True,user_id='e2047d17dbc34511b22b4ce54cb3dfe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:42 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-10f41e94-c93a-4fd5-bfac-8e4ff77ecb26 tempest-VolumesTransfersV357Test-1334344176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90422f42-18ab-4e91-abbe-3de2137b5bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:42 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-10f41e94-c93a-4fd5-bfac-8e4ff77ecb26 tempest-VolumesTransfersV357Test-1334344176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90422f42-18ab-4e91-abbe-3de2137b5bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:42 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-10f41e94-c93a-4fd5-bfac-8e4ff77ecb26 tempest-VolumesTransfersV357Test-1334344176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (243bd9af-170e-4dff-b82d-9e9540674bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:42 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-10f41e94-c93a-4fd5-bfac-8e4ff77ecb26 tempest-VolumesTransfersV357Test-1334344176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (243bd9af-170e-4dff-b82d-9e9540674bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a11cc141-9abe-49bd-80ed-c765d5d97f63', 'volume_name': 'volume-a11cc141-9abe-49bd-80ed-c765d5d97f63', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:42 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-10f41e94-c93a-4fd5-bfac-8e4ff77ecb26 tempest-VolumesTransfersV357Test-1334344176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7bb6da6-41f4-495e-ab31-249ec8e90eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:42 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-10f41e94-c93a-4fd5-bfac-8e4ff77ecb26 tempest-VolumesTransfersV357Test-1334344176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7bb6da6-41f4-495e-ab31-249ec8e90eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:42 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-10f41e94-c93a-4fd5-bfac-8e4ff77ecb26 tempest-VolumesTransfersV357Test-1334344176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09ac3f13-f7bc-4033-8d5b-3713c9ff6be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:42 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-10f41e94-c93a-4fd5-bfac-8e4ff77ecb26 tempest-VolumesTransfersV357Test-1334344176 None] Volume a11cc141-9abe-49bd-80ed-c765d5d97f63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a11cc141-9abe-49bd-80ed-c765d5d97f63', 'volume_size': 1}
Feb 28 04:44:42 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-10f41e94-c93a-4fd5-bfac-8e4ff77ecb26 tempest-VolumesTransfersV357Test-1334344176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:44:42 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-10f41e94-c93a-4fd5-bfac-8e4ff77ecb26 tempest-VolumesTransfersV357Test-1334344176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:44:42 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-10f41e94-c93a-4fd5-bfac-8e4ff77ecb26 tempest-VolumesTransfersV357Test-1334344176 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1927522087',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a11cc141-9abe-49bd-80ed-c765d5d97f63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b7cd29fa47840d5b9a65abb05c1ca72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:44:42Z,use_quota=True,user_id='e2047d17dbc34511b22b4ce54cb3dfe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:44:42 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-10f41e94-c93a-4fd5-bfac-8e4ff77ecb26 tempest-VolumesTransfersV357Test-1334344176 None] Creating volume a11cc141-9abe-49bd-80ed-c765d5d97f63 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:44:42 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-10f41e94-c93a-4fd5-bfac-8e4ff77ecb26 tempest-VolumesTransfersV357Test-1334344176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:44:42 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-10f41e94-c93a-4fd5-bfac-8e4ff77ecb26 tempest-VolumesTransfersV357Test-1334344176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:44:42 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-10f41e94-c93a-4fd5-bfac-8e4ff77ecb26 tempest-VolumesTransfersV357Test-1334344176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:44:42 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-10f41e94-c93a-4fd5-bfac-8e4ff77ecb26 tempest-VolumesTransfersV357Test-1334344176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:44:42 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-10f41e94-c93a-4fd5-bfac-8e4ff77ecb26 tempest-VolumesTransfersV357Test-1334344176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:44:42 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-10f41e94-c93a-4fd5-bfac-8e4ff77ecb26 tempest-VolumesTransfersV357Test-1334344176 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:44:42 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-10f41e94-c93a-4fd5-bfac-8e4ff77ecb26 tempest-VolumesTransfersV357Test-1334344176 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:44:42 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-10f41e94-c93a-4fd5-bfac-8e4ff77ecb26 tempest-VolumesTransfersV357Test-1334344176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a11cc141-9abe-49bd-80ed-c765d5d97f63 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:42 devstack sudo[87977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a11cc141-9abe-49bd-80ed-c765d5d97f63 1073741824
Feb 28 04:44:42 devstack sudo[87977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:43 devstack sudo[87977]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:43 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-10f41e94-c93a-4fd5-bfac-8e4ff77ecb26 tempest-VolumesTransfersV357Test-1334344176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a11cc141-9abe-49bd-80ed-c765d5d97f63 1073741824" returned: 0 in 0.624s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:43 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-10f41e94-c93a-4fd5-bfac-8e4ff77ecb26 tempest-VolumesTransfersV357Test-1334344176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a11cc141-9abe-49bd-80ed-c765d5d97f63 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:43 devstack sudo[87982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a11cc141-9abe-49bd-80ed-c765d5d97f63
Feb 28 04:44:43 devstack sudo[87982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:44 devstack sudo[87982]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-10f41e94-c93a-4fd5-bfac-8e4ff77ecb26 tempest-VolumesTransfersV357Test-1334344176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a11cc141-9abe-49bd-80ed-c765d5d97f63" returned: 0 in 1.125s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:44 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-10f41e94-c93a-4fd5-bfac-8e4ff77ecb26 tempest-VolumesTransfersV357Test-1334344176 None] <== create_volume: return (1787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:44:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-10f41e94-c93a-4fd5-bfac-8e4ff77ecb26 tempest-VolumesTransfersV357Test-1334344176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.789s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:44:44 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-10f41e94-c93a-4fd5-bfac-8e4ff77ecb26 tempest-VolumesTransfersV357Test-1334344176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09ac3f13-f7bc-4033-8d5b-3713c9ff6be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a11cc141-9abe-49bd-80ed-c765d5d97f63', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:44 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-10f41e94-c93a-4fd5-bfac-8e4ff77ecb26 tempest-VolumesTransfersV357Test-1334344176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55e47d42-f18f-4529-b061-ad79496862f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:44 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-10f41e94-c93a-4fd5-bfac-8e4ff77ecb26 tempest-VolumesTransfersV357Test-1334344176 None] Volume volume-a11cc141-9abe-49bd-80ed-c765d5d97f63 (a11cc141-9abe-49bd-80ed-c765d5d97f63): created successfully
Feb 28 04:44:44 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-10f41e94-c93a-4fd5-bfac-8e4ff77ecb26 tempest-VolumesTransfersV357Test-1334344176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55e47d42-f18f-4529-b061-ad79496862f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:44 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-10f41e94-c93a-4fd5-bfac-8e4ff77ecb26 tempest-VolumesTransfersV357Test-1334344176 None] Flow 'volume_create_manager' (89589257-7fa0-42f3-95ff-28a4777784eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:44:44 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-10f41e94-c93a-4fd5-bfac-8e4ff77ecb26 tempest-VolumesTransfersV357Test-1334344176 None] Created volume successfully.
Feb 28 04:44:45 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-2302823b-b8d4-41f8-97bc-4b93736c23c8 tempest-VolumesTransfersV357Test-669837781 None] Transfer volume completed successfully.
Feb 28 04:44:47 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-ceb31cf3-7448-46d1-9f7e-c10c0af5365e tempest-VolumesActionsTest-4540298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:44:47 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ceb31cf3-7448-46d1-9f7e-c10c0af5365e tempest-VolumesActionsTest-4540298 None] Flow 'volume_create_manager' (9c21b233-7c54-4599-b7e4-450c9603abd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:44:47 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ceb31cf3-7448-46d1-9f7e-c10c0af5365e tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5babdc70-ba58-489e-87f9-9c4f2020ab54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:47 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ceb31cf3-7448-46d1-9f7e-c10c0af5365e tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5babdc70-ba58-489e-87f9-9c4f2020ab54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:44:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-749847476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb282f2e-4d94-41e1-8db7-9e8c9000d1ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af27b7a098294a58b84dd04067ce0e24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:44:47Z,use_quota=True,user_id='4e66d3f79b074645a4e80b9f7a373a42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:47 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ceb31cf3-7448-46d1-9f7e-c10c0af5365e tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1cd187a-12db-46d7-823c-02c011311a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:47 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ceb31cf3-7448-46d1-9f7e-c10c0af5365e tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1cd187a-12db-46d7-823c-02c011311a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:47 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ceb31cf3-7448-46d1-9f7e-c10c0af5365e tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a341c890-8225-4f8b-8233-b7fc1d91589d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:47 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ceb31cf3-7448-46d1-9f7e-c10c0af5365e tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a341c890-8225-4f8b-8233-b7fc1d91589d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb282f2e-4d94-41e1-8db7-9e8c9000d1ac', 'volume_name': 'volume-fb282f2e-4d94-41e1-8db7-9e8c9000d1ac', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:47 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ceb31cf3-7448-46d1-9f7e-c10c0af5365e tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a973c69-d961-4638-87c0-05cf9b7cd1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:47 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ceb31cf3-7448-46d1-9f7e-c10c0af5365e tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a973c69-d961-4638-87c0-05cf9b7cd1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:47 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ceb31cf3-7448-46d1-9f7e-c10c0af5365e tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04f50273-5873-4f3e-b736-ca251e9d2faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:47 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-ceb31cf3-7448-46d1-9f7e-c10c0af5365e tempest-VolumesActionsTest-4540298 None] Volume fb282f2e-4d94-41e1-8db7-9e8c9000d1ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb282f2e-4d94-41e1-8db7-9e8c9000d1ac', 'volume_size': 1}
Feb 28 04:44:47 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ceb31cf3-7448-46d1-9f7e-c10c0af5365e tempest-VolumesActionsTest-4540298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:44:47 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ceb31cf3-7448-46d1-9f7e-c10c0af5365e tempest-VolumesActionsTest-4540298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:44:47 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-ceb31cf3-7448-46d1-9f7e-c10c0af5365e tempest-VolumesActionsTest-4540298 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:44:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-749847476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb282f2e-4d94-41e1-8db7-9e8c9000d1ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af27b7a098294a58b84dd04067ce0e24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:44:47Z,use_quota=True,user_id='4e66d3f79b074645a4e80b9f7a373a42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:44:47 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-ceb31cf3-7448-46d1-9f7e-c10c0af5365e tempest-VolumesActionsTest-4540298 None] Creating volume fb282f2e-4d94-41e1-8db7-9e8c9000d1ac {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:44:47 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ceb31cf3-7448-46d1-9f7e-c10c0af5365e tempest-VolumesActionsTest-4540298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:44:47 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ceb31cf3-7448-46d1-9f7e-c10c0af5365e tempest-VolumesActionsTest-4540298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:44:47 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-ceb31cf3-7448-46d1-9f7e-c10c0af5365e tempest-VolumesActionsTest-4540298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:44:47 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-ceb31cf3-7448-46d1-9f7e-c10c0af5365e tempest-VolumesActionsTest-4540298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:44:47 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ceb31cf3-7448-46d1-9f7e-c10c0af5365e tempest-VolumesActionsTest-4540298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:44:47 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-ceb31cf3-7448-46d1-9f7e-c10c0af5365e tempest-VolumesActionsTest-4540298 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:44:47 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-ceb31cf3-7448-46d1-9f7e-c10c0af5365e tempest-VolumesActionsTest-4540298 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:44:47 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ceb31cf3-7448-46d1-9f7e-c10c0af5365e tempest-VolumesActionsTest-4540298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-fb282f2e-4d94-41e1-8db7-9e8c9000d1ac 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:47 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-be44db4a-b41f-4cab-a04f-de420788f1ae tempest-VolumesTransfersV357Test-1193350213 None] Acquiring lock "cinder-a11cc141-9abe-49bd-80ed-c765d5d97f63-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:44:47 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-be44db4a-b41f-4cab-a04f-de420788f1ae tempest-VolumesTransfersV357Test-1193350213 None] Lock "cinder-a11cc141-9abe-49bd-80ed-c765d5d97f63-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:44:47 devstack sudo[88026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-fb282f2e-4d94-41e1-8db7-9e8c9000d1ac 1073741824
Feb 28 04:44:47 devstack sudo[88026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:47 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-be44db4a-b41f-4cab-a04f-de420788f1ae tempest-VolumesTransfersV357Test-1193350213 None] Acquiring lock "cinder-quobyte-a11cc141-9abe-49bd-80ed-c765d5d97f63" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:44:47 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-be44db4a-b41f-4cab-a04f-de420788f1ae tempest-VolumesTransfersV357Test-1193350213 None] Lock "cinder-quobyte-a11cc141-9abe-49bd-80ed-c765d5d97f63" acquired by "delete_volume" :: waited 0.020s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:44:47 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[178d71d6-42d0-4085-b6d2-86f19c615330]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:44:47 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-be44db4a-b41f-4cab-a04f-de420788f1ae tempest-VolumesTransfersV357Test-1193350213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a11cc141-9abe-49bd-80ed-c765d5d97f63 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:48 devstack sudo[88029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a11cc141-9abe-49bd-80ed-c765d5d97f63
Feb 28 04:44:48 devstack sudo[88029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:48 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-a053ebc1-1605-48c4-8b1f-6239386f0180 tempest-VolumesDeleteCascade-906689606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:44:48 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a053ebc1-1605-48c4-8b1f-6239386f0180 tempest-VolumesDeleteCascade-906689606 None] Flow 'volume_create_manager' (49af33a3-47b8-46e9-966f-4a5f347f8be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:44:48 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a053ebc1-1605-48c4-8b1f-6239386f0180 tempest-VolumesDeleteCascade-906689606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (567f7297-fe24-4258-90ca-b31be2edc32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:48 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a053ebc1-1605-48c4-8b1f-6239386f0180 tempest-VolumesDeleteCascade-906689606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (567f7297-fe24-4258-90ca-b31be2edc32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:44:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-731716010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4307a7d9-674a-460c-857d-977b65d4fb9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f56b2178a364e9eaa85d0a224a2ce79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:44:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:44:48Z,use_quota=True,user_id='ea39a12c50304676a7627a0ff3e77341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:48 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a053ebc1-1605-48c4-8b1f-6239386f0180 tempest-VolumesDeleteCascade-906689606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21c367c6-d43f-47ba-9926-a9941cd27534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:48 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a053ebc1-1605-48c4-8b1f-6239386f0180 tempest-VolumesDeleteCascade-906689606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21c367c6-d43f-47ba-9926-a9941cd27534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:48 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a053ebc1-1605-48c4-8b1f-6239386f0180 tempest-VolumesDeleteCascade-906689606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f44c083-8c72-4b87-b533-7027c502d515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:48 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a053ebc1-1605-48c4-8b1f-6239386f0180 tempest-VolumesDeleteCascade-906689606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f44c083-8c72-4b87-b533-7027c502d515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4307a7d9-674a-460c-857d-977b65d4fb9e', 'volume_name': 'volume-4307a7d9-674a-460c-857d-977b65d4fb9e', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:48 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a053ebc1-1605-48c4-8b1f-6239386f0180 tempest-VolumesDeleteCascade-906689606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88b14a01-c117-456a-8194-809e764840ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:48 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a053ebc1-1605-48c4-8b1f-6239386f0180 tempest-VolumesDeleteCascade-906689606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88b14a01-c117-456a-8194-809e764840ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:48 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a053ebc1-1605-48c4-8b1f-6239386f0180 tempest-VolumesDeleteCascade-906689606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db23fa3-e548-43ba-bdc8-28a6425d73c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:48 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-a053ebc1-1605-48c4-8b1f-6239386f0180 tempest-VolumesDeleteCascade-906689606 None] Volume 4307a7d9-674a-460c-857d-977b65d4fb9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4307a7d9-674a-460c-857d-977b65d4fb9e', 'volume_size': 1}
Feb 28 04:44:48 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a053ebc1-1605-48c4-8b1f-6239386f0180 tempest-VolumesDeleteCascade-906689606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:44:48 devstack sudo[88029]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:48 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-be44db4a-b41f-4cab-a04f-de420788f1ae tempest-VolumesTransfersV357Test-1193350213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a11cc141-9abe-49bd-80ed-c765d5d97f63" returned: 0 in 0.752s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:48 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-be44db4a-b41f-4cab-a04f-de420788f1ae tempest-VolumesTransfersV357Test-1193350213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a11cc141-9abe-49bd-80ed-c765d5d97f63 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:48 devstack sudo[88039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a11cc141-9abe-49bd-80ed-c765d5d97f63
Feb 28 04:44:48 devstack sudo[88039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:48 devstack sudo[88026]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:48 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ceb31cf3-7448-46d1-9f7e-c10c0af5365e tempest-VolumesActionsTest-4540298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-fb282f2e-4d94-41e1-8db7-9e8c9000d1ac 1073741824" returned: 0 in 1.063s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:48 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ceb31cf3-7448-46d1-9f7e-c10c0af5365e tempest-VolumesActionsTest-4540298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-fb282f2e-4d94-41e1-8db7-9e8c9000d1ac {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:48 devstack sudo[88041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-fb282f2e-4d94-41e1-8db7-9e8c9000d1ac
Feb 28 04:44:48 devstack sudo[88041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:49 devstack sudo[88039]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-be44db4a-b41f-4cab-a04f-de420788f1ae tempest-VolumesTransfersV357Test-1193350213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a11cc141-9abe-49bd-80ed-c765d5d97f63" returned: 0 in 0.520s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:49 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-be44db4a-b41f-4cab-a04f-de420788f1ae tempest-VolumesTransfersV357Test-1193350213 None] Lock "cinder-quobyte-a11cc141-9abe-49bd-80ed-c765d5d97f63" released by "delete_volume" :: held 1.336s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:44:49 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-be44db4a-b41f-4cab-a04f-de420788f1ae tempest-VolumesTransfersV357Test-1193350213 None] Created reservations ['2849a0c6-b21f-4b21-9bee-98cde2f48cc2', 'b9cd43ae-c2ce-447b-9cf7-41a91c881cf7', '29658ca3-fb9d-4766-94f8-4d193b00a79c', '75da9bc2-f710-40c2-bbfc-a7b17e480b02'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:44:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-be44db4a-b41f-4cab-a04f-de420788f1ae tempest-VolumesTransfersV357Test-1193350213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:44:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-be44db4a-b41f-4cab-a04f-de420788f1ae tempest-VolumesTransfersV357Test-1193350213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:44:49 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-be44db4a-b41f-4cab-a04f-de420788f1ae tempest-VolumesTransfersV357Test-1193350213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:44:49 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-be44db4a-b41f-4cab-a04f-de420788f1ae tempest-VolumesTransfersV357Test-1193350213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:44:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-be44db4a-b41f-4cab-a04f-de420788f1ae tempest-VolumesTransfersV357Test-1193350213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:44:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-be44db4a-b41f-4cab-a04f-de420788f1ae tempest-VolumesTransfersV357Test-1193350213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:49 devstack sudo[88045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:44:49 devstack sudo[88045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:49 devstack sudo[88041]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ceb31cf3-7448-46d1-9f7e-c10c0af5365e tempest-VolumesActionsTest-4540298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-fb282f2e-4d94-41e1-8db7-9e8c9000d1ac" returned: 0 in 0.491s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:49 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-ceb31cf3-7448-46d1-9f7e-c10c0af5365e tempest-VolumesActionsTest-4540298 None] <== create_volume: return (1672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:44:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ceb31cf3-7448-46d1-9f7e-c10c0af5365e tempest-VolumesActionsTest-4540298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:44:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a053ebc1-1605-48c4-8b1f-6239386f0180 tempest-VolumesDeleteCascade-906689606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.130s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:44:49 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-a053ebc1-1605-48c4-8b1f-6239386f0180 tempest-VolumesDeleteCascade-906689606 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:44:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-731716010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4307a7d9-674a-460c-857d-977b65d4fb9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f56b2178a364e9eaa85d0a224a2ce79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:44:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:44:48Z,use_quota=True,user_id='ea39a12c50304676a7627a0ff3e77341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:44:49 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-a053ebc1-1605-48c4-8b1f-6239386f0180 tempest-VolumesDeleteCascade-906689606 None] Creating volume 4307a7d9-674a-460c-857d-977b65d4fb9e {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:44:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a053ebc1-1605-48c4-8b1f-6239386f0180 tempest-VolumesDeleteCascade-906689606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:44:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a053ebc1-1605-48c4-8b1f-6239386f0180 tempest-VolumesDeleteCascade-906689606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:44:49 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-a053ebc1-1605-48c4-8b1f-6239386f0180 tempest-VolumesDeleteCascade-906689606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:44:49 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-a053ebc1-1605-48c4-8b1f-6239386f0180 tempest-VolumesDeleteCascade-906689606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:44:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a053ebc1-1605-48c4-8b1f-6239386f0180 tempest-VolumesDeleteCascade-906689606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:44:49 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-a053ebc1-1605-48c4-8b1f-6239386f0180 tempest-VolumesDeleteCascade-906689606 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:44:49 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-a053ebc1-1605-48c4-8b1f-6239386f0180 tempest-VolumesDeleteCascade-906689606 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:44:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a053ebc1-1605-48c4-8b1f-6239386f0180 tempest-VolumesDeleteCascade-906689606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:49 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ceb31cf3-7448-46d1-9f7e-c10c0af5365e tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04f50273-5873-4f3e-b736-ca251e9d2faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb282f2e-4d94-41e1-8db7-9e8c9000d1ac', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:49 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ceb31cf3-7448-46d1-9f7e-c10c0af5365e tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39dfcbb0-cc88-4294-97f4-cfb413ee217c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:49 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-ceb31cf3-7448-46d1-9f7e-c10c0af5365e tempest-VolumesActionsTest-4540298 None] Volume volume-fb282f2e-4d94-41e1-8db7-9e8c9000d1ac (fb282f2e-4d94-41e1-8db7-9e8c9000d1ac): created successfully
Feb 28 04:44:49 devstack sudo[88047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e 1073741824
Feb 28 04:44:49 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ceb31cf3-7448-46d1-9f7e-c10c0af5365e tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39dfcbb0-cc88-4294-97f4-cfb413ee217c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:49 devstack sudo[88047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:49 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ceb31cf3-7448-46d1-9f7e-c10c0af5365e tempest-VolumesActionsTest-4540298 None] Flow 'volume_create_manager' (9c21b233-7c54-4599-b7e4-450c9603abd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:44:49 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-ceb31cf3-7448-46d1-9f7e-c10c0af5365e tempest-VolumesActionsTest-4540298 None] Created volume successfully.
Feb 28 04:44:49 devstack sudo[88045]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-be44db4a-b41f-4cab-a04f-de420788f1ae tempest-VolumesTransfersV357Test-1193350213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.460s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:49 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-be44db4a-b41f-4cab-a04f-de420788f1ae tempest-VolumesTransfersV357Test-1193350213 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:44:49 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-be44db4a-b41f-4cab-a04f-de420788f1ae tempest-VolumesTransfersV357Test-1193350213 None] Deleted volume successfully.
Feb 28 04:44:49 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-be44db4a-b41f-4cab-a04f-de420788f1ae tempest-VolumesTransfersV357Test-1193350213 None] Lock "cinder-a11cc141-9abe-49bd-80ed-c765d5d97f63-delete_volume" released by "delete_volume" :: held 1.962s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:44:50 devstack sudo[88047]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a053ebc1-1605-48c4-8b1f-6239386f0180 tempest-VolumesDeleteCascade-906689606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e 1073741824" returned: 0 in 0.669s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a053ebc1-1605-48c4-8b1f-6239386f0180 tempest-VolumesDeleteCascade-906689606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:50 devstack sudo[88054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e
Feb 28 04:44:50 devstack sudo[88054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:50 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-42c4a10b-70c5-4527-b0c5-160c67b5d388 tempest-VolumesTransfersV357Test-1334344176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:44:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-42c4a10b-70c5-4527-b0c5-160c67b5d388 tempest-VolumesTransfersV357Test-1334344176 None] Flow 'volume_create_manager' (d0707577-b5cd-41d0-8e61-3a6dd2733c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:44:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-42c4a10b-70c5-4527-b0c5-160c67b5d388 tempest-VolumesTransfersV357Test-1334344176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9abd76c0-26b4-402a-a0e2-fd698bae3fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-42c4a10b-70c5-4527-b0c5-160c67b5d388 tempest-VolumesTransfersV357Test-1334344176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9abd76c0-26b4-402a-a0e2-fd698bae3fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-194123504',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0052055b-5081-489e-8879-1e0f527cc81a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b7cd29fa47840d5b9a65abb05c1ca72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:44:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:44:50Z,use_quota=True,user_id='e2047d17dbc34511b22b4ce54cb3dfe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-42c4a10b-70c5-4527-b0c5-160c67b5d388 tempest-VolumesTransfersV357Test-1334344176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a3d7a7e-4a1e-41c5-a91c-c56f911fbce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-42c4a10b-70c5-4527-b0c5-160c67b5d388 tempest-VolumesTransfersV357Test-1334344176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a3d7a7e-4a1e-41c5-a91c-c56f911fbce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-42c4a10b-70c5-4527-b0c5-160c67b5d388 tempest-VolumesTransfersV357Test-1334344176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a908b984-2e15-49f6-afb2-078a04d1122b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-42c4a10b-70c5-4527-b0c5-160c67b5d388 tempest-VolumesTransfersV357Test-1334344176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a908b984-2e15-49f6-afb2-078a04d1122b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0052055b-5081-489e-8879-1e0f527cc81a', 'volume_name': 'volume-0052055b-5081-489e-8879-1e0f527cc81a', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-42c4a10b-70c5-4527-b0c5-160c67b5d388 tempest-VolumesTransfersV357Test-1334344176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ae86e80-8bfa-4d0c-93bf-ea1243f0aa82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-42c4a10b-70c5-4527-b0c5-160c67b5d388 tempest-VolumesTransfersV357Test-1334344176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ae86e80-8bfa-4d0c-93bf-ea1243f0aa82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-42c4a10b-70c5-4527-b0c5-160c67b5d388 tempest-VolumesTransfersV357Test-1334344176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (978c54dd-345b-4b39-a7b2-c901fbe638fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:50 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-42c4a10b-70c5-4527-b0c5-160c67b5d388 tempest-VolumesTransfersV357Test-1334344176 None] Volume 0052055b-5081-489e-8879-1e0f527cc81a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0052055b-5081-489e-8879-1e0f527cc81a', 'volume_size': 1}
Feb 28 04:44:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-42c4a10b-70c5-4527-b0c5-160c67b5d388 tempest-VolumesTransfersV357Test-1334344176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:44:50 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-b4ce5b30-9d07-4225-9520-31d85956f7de tempest-VolumesActionsTest-4540298 None] Acquiring lock "cinder-fb282f2e-4d94-41e1-8db7-9e8c9000d1ac" by "attach_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:44:50 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-b4ce5b30-9d07-4225-9520-31d85956f7de tempest-VolumesActionsTest-4540298 None] Lock "cinder-fb282f2e-4d94-41e1-8db7-9e8c9000d1ac" acquired by "attach_volume" :: waited 0.009s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:44:50 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-b4ce5b30-9d07-4225-9520-31d85956f7de tempest-VolumesActionsTest-4540298 None] Attaching volume fb282f2e-4d94-41e1-8db7-9e8c9000d1ac to instance a3236da3-0427-4d30-b5d9-8baf726e0628 at mountpoint /dev/vdb on host None.
Feb 28 04:44:50 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-b4ce5b30-9d07-4225-9520-31d85956f7de tempest-VolumesActionsTest-4540298 None] Attach volume completed successfully.
Feb 28 04:44:50 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-b4ce5b30-9d07-4225-9520-31d85956f7de tempest-VolumesActionsTest-4540298 None] Lock "cinder-fb282f2e-4d94-41e1-8db7-9e8c9000d1ac" released by "attach_volume" :: held 0.065s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:44:50 devstack sudo[88054]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a053ebc1-1605-48c4-8b1f-6239386f0180 tempest-VolumesDeleteCascade-906689606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e" returned: 0 in 0.634s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:50 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-a053ebc1-1605-48c4-8b1f-6239386f0180 tempest-VolumesDeleteCascade-906689606 None] <== create_volume: return (1330ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:44:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a053ebc1-1605-48c4-8b1f-6239386f0180 tempest-VolumesDeleteCascade-906689606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.333s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:44:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-42c4a10b-70c5-4527-b0c5-160c67b5d388 tempest-VolumesTransfersV357Test-1334344176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.160s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:44:50 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-42c4a10b-70c5-4527-b0c5-160c67b5d388 tempest-VolumesTransfersV357Test-1334344176 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-194123504',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0052055b-5081-489e-8879-1e0f527cc81a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b7cd29fa47840d5b9a65abb05c1ca72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:44:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:44:50Z,use_quota=True,user_id='e2047d17dbc34511b22b4ce54cb3dfe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:44:50 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-42c4a10b-70c5-4527-b0c5-160c67b5d388 tempest-VolumesTransfersV357Test-1334344176 None] Creating volume 0052055b-5081-489e-8879-1e0f527cc81a {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:44:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-42c4a10b-70c5-4527-b0c5-160c67b5d388 tempest-VolumesTransfersV357Test-1334344176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:44:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-42c4a10b-70c5-4527-b0c5-160c67b5d388 tempest-VolumesTransfersV357Test-1334344176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:44:50 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-42c4a10b-70c5-4527-b0c5-160c67b5d388 tempest-VolumesTransfersV357Test-1334344176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:44:50 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-42c4a10b-70c5-4527-b0c5-160c67b5d388 tempest-VolumesTransfersV357Test-1334344176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:44:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-42c4a10b-70c5-4527-b0c5-160c67b5d388 tempest-VolumesTransfersV357Test-1334344176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:44:50 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-42c4a10b-70c5-4527-b0c5-160c67b5d388 tempest-VolumesTransfersV357Test-1334344176 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:44:50 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-42c4a10b-70c5-4527-b0c5-160c67b5d388 tempest-VolumesTransfersV357Test-1334344176 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:44:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-42c4a10b-70c5-4527-b0c5-160c67b5d388 tempest-VolumesTransfersV357Test-1334344176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0052055b-5081-489e-8879-1e0f527cc81a 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a053ebc1-1605-48c4-8b1f-6239386f0180 tempest-VolumesDeleteCascade-906689606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db23fa3-e548-43ba-bdc8-28a6425d73c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4307a7d9-674a-460c-857d-977b65d4fb9e', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a053ebc1-1605-48c4-8b1f-6239386f0180 tempest-VolumesDeleteCascade-906689606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b36e2829-9c53-4a80-8694-15f140c2a7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:50 devstack sudo[88057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0052055b-5081-489e-8879-1e0f527cc81a 1073741824
Feb 28 04:44:50 devstack sudo[88057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:50 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-a053ebc1-1605-48c4-8b1f-6239386f0180 tempest-VolumesDeleteCascade-906689606 None] Volume volume-4307a7d9-674a-460c-857d-977b65d4fb9e (4307a7d9-674a-460c-857d-977b65d4fb9e): created successfully
Feb 28 04:44:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a053ebc1-1605-48c4-8b1f-6239386f0180 tempest-VolumesDeleteCascade-906689606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b36e2829-9c53-4a80-8694-15f140c2a7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a053ebc1-1605-48c4-8b1f-6239386f0180 tempest-VolumesDeleteCascade-906689606 None] Flow 'volume_create_manager' (49af33a3-47b8-46e9-966f-4a5f347f8be4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:44:50 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-a053ebc1-1605-48c4-8b1f-6239386f0180 tempest-VolumesDeleteCascade-906689606 None] Created volume successfully.
Feb 28 04:44:51 devstack sudo[88057]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-42c4a10b-70c5-4527-b0c5-160c67b5d388 tempest-VolumesTransfersV357Test-1334344176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0052055b-5081-489e-8879-1e0f527cc81a 1073741824" returned: 0 in 0.578s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-42c4a10b-70c5-4527-b0c5-160c67b5d388 tempest-VolumesTransfersV357Test-1334344176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0052055b-5081-489e-8879-1e0f527cc81a {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:51 devstack sudo[88067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0052055b-5081-489e-8879-1e0f527cc81a
Feb 28 04:44:51 devstack sudo[88067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:51 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-6022e710-96e3-41a0-abe1-ef056bedc5f1 tempest-VolumesActionsTest-275771739 None] Terminate volume connection completed successfully.
Feb 28 04:44:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-cfce089e-234b-445e-81b7-370edca3fe2e tempest-VolumesDeleteCascade-906689606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:44:51 devstack sudo[88067]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-42c4a10b-70c5-4527-b0c5-160c67b5d388 tempest-VolumesTransfersV357Test-1334344176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0052055b-5081-489e-8879-1e0f527cc81a" returned: 0 in 0.577s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:51 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-42c4a10b-70c5-4527-b0c5-160c67b5d388 tempest-VolumesTransfersV357Test-1334344176 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:44:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-42c4a10b-70c5-4527-b0c5-160c67b5d388 tempest-VolumesTransfersV357Test-1334344176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:44:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-cfce089e-234b-445e-81b7-370edca3fe2e tempest-VolumesDeleteCascade-906689606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.208s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:44:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-42c4a10b-70c5-4527-b0c5-160c67b5d388 tempest-VolumesTransfersV357Test-1334344176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (978c54dd-345b-4b39-a7b2-c901fbe638fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0052055b-5081-489e-8879-1e0f527cc81a', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-42c4a10b-70c5-4527-b0c5-160c67b5d388 tempest-VolumesTransfersV357Test-1334344176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0599fbe5-f754-4f9e-8ad1-14dccdb6ddd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:44:51 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-cfce089e-234b-445e-81b7-370edca3fe2e tempest-VolumesDeleteCascade-906689606 None] Creating offline snapshot dd5e31bc-ae2d-47e4-a008-30c81dfdb2ed of volume 4307a7d9-674a-460c-857d-977b65d4fb9e {{(pid=84248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 04:44:51 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-42c4a10b-70c5-4527-b0c5-160c67b5d388 tempest-VolumesTransfersV357Test-1334344176 None] Volume volume-0052055b-5081-489e-8879-1e0f527cc81a (0052055b-5081-489e-8879-1e0f527cc81a): created successfully
Feb 28 04:44:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-42c4a10b-70c5-4527-b0c5-160c67b5d388 tempest-VolumesTransfersV357Test-1334344176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0599fbe5-f754-4f9e-8ad1-14dccdb6ddd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:44:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-42c4a10b-70c5-4527-b0c5-160c67b5d388 tempest-VolumesTransfersV357Test-1334344176 None] Flow 'volume_create_manager' (d0707577-b5cd-41d0-8e61-3a6dd2733c50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:44:51 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[066d1ff3-3f26-45ee-aeef-acfda6e45d1b]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:44:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-cfce089e-234b-445e-81b7-370edca3fe2e tempest-VolumesDeleteCascade-906689606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:51 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-42c4a10b-70c5-4527-b0c5-160c67b5d388 tempest-VolumesTransfersV357Test-1334344176 None] Created volume successfully.
Feb 28 04:44:52 devstack sudo[88070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e
Feb 28 04:44:52 devstack sudo[88070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:52 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6022e710-96e3-41a0-abe1-ef056bedc5f1 tempest-VolumesActionsTest-275771739 None] Acquiring lock "cinder-fb282f2e-4d94-41e1-8db7-9e8c9000d1ac-detach_volume" by "detach_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:44:52 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6022e710-96e3-41a0-abe1-ef056bedc5f1 tempest-VolumesActionsTest-275771739 None] Lock "cinder-fb282f2e-4d94-41e1-8db7-9e8c9000d1ac-detach_volume" acquired by "detach_volume" :: waited 0.010s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:44:52 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-6022e710-96e3-41a0-abe1-ef056bedc5f1 tempest-VolumesActionsTest-275771739 None] Detaching volume fb282f2e-4d94-41e1-8db7-9e8c9000d1ac from instance a3236da3-0427-4d30-b5d9-8baf726e0628.
Feb 28 04:44:52 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-6022e710-96e3-41a0-abe1-ef056bedc5f1 tempest-VolumesActionsTest-275771739 None] Detach volume completed successfully.
Feb 28 04:44:52 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6022e710-96e3-41a0-abe1-ef056bedc5f1 tempest-VolumesActionsTest-275771739 None] Lock "cinder-fb282f2e-4d94-41e1-8db7-9e8c9000d1ac-detach_volume" released by "detach_volume" :: held 0.045s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:44:52 devstack sudo[88070]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-cfce089e-234b-445e-81b7-370edca3fe2e tempest-VolumesDeleteCascade-906689606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e" returned: 0 in 0.543s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-cfce089e-234b-445e-81b7-370edca3fe2e tempest-VolumesDeleteCascade-906689606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.dd5e31bc-ae2d-47e4-a008-30c81dfdb2ed 1G {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:52 devstack sudo[88075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.dd5e31bc-ae2d-47e4-a008-30c81dfdb2ed 1G
Feb 28 04:44:52 devstack sudo[88075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:53 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-0da64371-4bb5-48b1-a750-bdf15bcc54a2 tempest-VolumesActionsTest-4540298 None] Acquiring lock "cinder-fb282f2e-4d94-41e1-8db7-9e8c9000d1ac-detach_volume" by "detach_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:44:53 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-0da64371-4bb5-48b1-a750-bdf15bcc54a2 tempest-VolumesActionsTest-4540298 None] Lock "cinder-fb282f2e-4d94-41e1-8db7-9e8c9000d1ac-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:44:53 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-0da64371-4bb5-48b1-a750-bdf15bcc54a2 tempest-VolumesActionsTest-4540298 None] Volume detach called, but volume not attached.
Feb 28 04:44:53 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-0da64371-4bb5-48b1-a750-bdf15bcc54a2 tempest-VolumesActionsTest-4540298 None] Lock "cinder-fb282f2e-4d94-41e1-8db7-9e8c9000d1ac-detach_volume" released by "detach_volume" :: held 0.030s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:44:53 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-783806b0-e667-4a10-82b4-3fabe5b7ba03 tempest-VolumesTransfersV357Test-1193350213 None] Acquiring lock "cinder-0052055b-5081-489e-8879-1e0f527cc81a-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:44:53 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-783806b0-e667-4a10-82b4-3fabe5b7ba03 tempest-VolumesTransfersV357Test-1193350213 None] Lock "cinder-0052055b-5081-489e-8879-1e0f527cc81a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:44:53 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-783806b0-e667-4a10-82b4-3fabe5b7ba03 tempest-VolumesTransfersV357Test-1193350213 None] Acquiring lock "cinder-quobyte-0052055b-5081-489e-8879-1e0f527cc81a" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:44:53 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-783806b0-e667-4a10-82b4-3fabe5b7ba03 tempest-VolumesTransfersV357Test-1193350213 None] Lock "cinder-quobyte-0052055b-5081-489e-8879-1e0f527cc81a" acquired by "delete_volume" :: waited 0.045s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:44:53 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28124d4-0f62-48b2-9186-1865644272ce]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:44:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-783806b0-e667-4a10-82b4-3fabe5b7ba03 tempest-VolumesTransfersV357Test-1193350213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0052055b-5081-489e-8879-1e0f527cc81a {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:53 devstack sudo[88105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0052055b-5081-489e-8879-1e0f527cc81a
Feb 28 04:44:53 devstack sudo[88105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:53 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-9b4bf7c7-0b53-4d2b-ad74-8d638a51a633 tempest-VolumesActionsTest-4540298 None] Acquiring lock "cinder-fb282f2e-4d94-41e1-8db7-9e8c9000d1ac-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:44:53 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-9b4bf7c7-0b53-4d2b-ad74-8d638a51a633 tempest-VolumesActionsTest-4540298 None] Lock "cinder-fb282f2e-4d94-41e1-8db7-9e8c9000d1ac-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:44:53 devstack sudo[88075]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-cfce089e-234b-445e-81b7-370edca3fe2e tempest-VolumesDeleteCascade-906689606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.dd5e31bc-ae2d-47e4-a008-30c81dfdb2ed 1G" returned: 0 in 1.432s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-cfce089e-234b-445e-81b7-370edca3fe2e tempest-VolumesDeleteCascade-906689606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4307a7d9-674a-460c-857d-977b65d4fb9e -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.dd5e31bc-ae2d-47e4-a008-30c81dfdb2ed {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:53 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-9b4bf7c7-0b53-4d2b-ad74-8d638a51a633 tempest-VolumesActionsTest-4540298 None] Acquiring lock "cinder-quobyte-fb282f2e-4d94-41e1-8db7-9e8c9000d1ac" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:44:53 devstack sudo[88109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4307a7d9-674a-460c-857d-977b65d4fb9e -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.dd5e31bc-ae2d-47e4-a008-30c81dfdb2ed
Feb 28 04:44:53 devstack sudo[88109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:53 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-9b4bf7c7-0b53-4d2b-ad74-8d638a51a633 tempest-VolumesActionsTest-4540298 None] Lock "cinder-quobyte-fb282f2e-4d94-41e1-8db7-9e8c9000d1ac" acquired by "delete_volume" :: waited 0.019s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:44:53 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2ce07e-c090-4a6b-98f8-771f3472d05e]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:44:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9b4bf7c7-0b53-4d2b-ad74-8d638a51a633 tempest-VolumesActionsTest-4540298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-fb282f2e-4d94-41e1-8db7-9e8c9000d1ac {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:54 devstack sudo[88111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-fb282f2e-4d94-41e1-8db7-9e8c9000d1ac
Feb 28 04:44:54 devstack sudo[88111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:54 devstack sudo[88105]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-783806b0-e667-4a10-82b4-3fabe5b7ba03 tempest-VolumesTransfersV357Test-1193350213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0052055b-5081-489e-8879-1e0f527cc81a" returned: 0 in 0.969s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-783806b0-e667-4a10-82b4-3fabe5b7ba03 tempest-VolumesTransfersV357Test-1193350213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0052055b-5081-489e-8879-1e0f527cc81a {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:54 devstack sudo[88116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0052055b-5081-489e-8879-1e0f527cc81a
Feb 28 04:44:54 devstack sudo[88116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:54 devstack sudo[88111]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9b4bf7c7-0b53-4d2b-ad74-8d638a51a633 tempest-VolumesActionsTest-4540298 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-fb282f2e-4d94-41e1-8db7-9e8c9000d1ac" returned: 0 in 0.966s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9b4bf7c7-0b53-4d2b-ad74-8d638a51a633 tempest-VolumesActionsTest-4540298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-fb282f2e-4d94-41e1-8db7-9e8c9000d1ac {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:54 devstack sudo[88123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-fb282f2e-4d94-41e1-8db7-9e8c9000d1ac
Feb 28 04:44:54 devstack sudo[88123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:55 devstack sudo[88116]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-783806b0-e667-4a10-82b4-3fabe5b7ba03 tempest-VolumesTransfersV357Test-1193350213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0052055b-5081-489e-8879-1e0f527cc81a" returned: 0 in 0.896s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:55 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-783806b0-e667-4a10-82b4-3fabe5b7ba03 tempest-VolumesTransfersV357Test-1193350213 None] Lock "cinder-quobyte-0052055b-5081-489e-8879-1e0f527cc81a" released by "delete_volume" :: held 1.947s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:44:55 devstack sudo[88109]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-cfce089e-234b-445e-81b7-370edca3fe2e tempest-VolumesDeleteCascade-906689606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4307a7d9-674a-460c-857d-977b65d4fb9e -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.dd5e31bc-ae2d-47e4-a008-30c81dfdb2ed" returned: 0 in 1.382s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:55 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-cfce089e-234b-445e-81b7-370edca3fe2e tempest-VolumesDeleteCascade-906689606 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.dd5e31bc-ae2d-47e4-a008-30c81dfdb2ed is being set with open permissions: ugo+rw
Feb 28 04:44:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-cfce089e-234b-445e-81b7-370edca3fe2e tempest-VolumesDeleteCascade-906689606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.dd5e31bc-ae2d-47e4-a008-30c81dfdb2ed {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:55 devstack sudo[88128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.dd5e31bc-ae2d-47e4-a008-30c81dfdb2ed
Feb 28 04:44:55 devstack sudo[88128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:55 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-783806b0-e667-4a10-82b4-3fabe5b7ba03 tempest-VolumesTransfersV357Test-1193350213 None] Created reservations ['adac85d2-6fa6-498b-9017-ec6b088d6834', '787976e3-4c71-46fe-bf8d-c51fabdf9814', 'f7444870-bea5-47fb-8833-96ea3cd037c9', 'fb722c18-2dfa-4edd-9f5a-e1d4bb07961f'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:44:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-783806b0-e667-4a10-82b4-3fabe5b7ba03 tempest-VolumesTransfersV357Test-1193350213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:44:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-783806b0-e667-4a10-82b4-3fabe5b7ba03 tempest-VolumesTransfersV357Test-1193350213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:44:55 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-783806b0-e667-4a10-82b4-3fabe5b7ba03 tempest-VolumesTransfersV357Test-1193350213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:44:55 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-783806b0-e667-4a10-82b4-3fabe5b7ba03 tempest-VolumesTransfersV357Test-1193350213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:44:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-783806b0-e667-4a10-82b4-3fabe5b7ba03 tempest-VolumesTransfersV357Test-1193350213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:44:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-783806b0-e667-4a10-82b4-3fabe5b7ba03 tempest-VolumesTransfersV357Test-1193350213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:55 devstack sudo[88131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:44:55 devstack sudo[88131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:55 devstack sudo[88123]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9b4bf7c7-0b53-4d2b-ad74-8d638a51a633 tempest-VolumesActionsTest-4540298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-fb282f2e-4d94-41e1-8db7-9e8c9000d1ac" returned: 0 in 0.701s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:55 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-9b4bf7c7-0b53-4d2b-ad74-8d638a51a633 tempest-VolumesActionsTest-4540298 None] Lock "cinder-quobyte-fb282f2e-4d94-41e1-8db7-9e8c9000d1ac" released by "delete_volume" :: held 1.723s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:44:55 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-9b4bf7c7-0b53-4d2b-ad74-8d638a51a633 tempest-VolumesActionsTest-4540298 None] Created reservations ['7d294c1e-1d23-47f3-aed1-1b5f09885f1b', '86f9829f-e393-40c3-a3e9-3a851050afdb', '29013faa-9678-4544-83dc-21f67a518b46', '07367787-03c9-49da-addf-e72f2e028902'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:44:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-9b4bf7c7-0b53-4d2b-ad74-8d638a51a633 tempest-VolumesActionsTest-4540298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:44:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-9b4bf7c7-0b53-4d2b-ad74-8d638a51a633 tempest-VolumesActionsTest-4540298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:44:55 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-9b4bf7c7-0b53-4d2b-ad74-8d638a51a633 tempest-VolumesActionsTest-4540298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:44:55 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-9b4bf7c7-0b53-4d2b-ad74-8d638a51a633 tempest-VolumesActionsTest-4540298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:44:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-9b4bf7c7-0b53-4d2b-ad74-8d638a51a633 tempest-VolumesActionsTest-4540298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:44:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9b4bf7c7-0b53-4d2b-ad74-8d638a51a633 tempest-VolumesActionsTest-4540298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:55 devstack sudo[88133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:44:55 devstack sudo[88133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:56 devstack sudo[88131]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:56 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-783806b0-e667-4a10-82b4-3fabe5b7ba03 tempest-VolumesTransfersV357Test-1193350213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 1.051s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:56 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-783806b0-e667-4a10-82b4-3fabe5b7ba03 tempest-VolumesTransfersV357Test-1193350213 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:44:56 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-783806b0-e667-4a10-82b4-3fabe5b7ba03 tempest-VolumesTransfersV357Test-1193350213 None] Deleted volume successfully.
Feb 28 04:44:56 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-783806b0-e667-4a10-82b4-3fabe5b7ba03 tempest-VolumesTransfersV357Test-1193350213 None] Lock "cinder-0052055b-5081-489e-8879-1e0f527cc81a-delete_volume" released by "delete_volume" :: held 3.441s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:44:56 devstack sudo[88128]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:56 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-cfce089e-234b-445e-81b7-370edca3fe2e tempest-VolumesDeleteCascade-906689606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.dd5e31bc-ae2d-47e4-a008-30c81dfdb2ed" returned: 0 in 1.308s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:56 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-cfce089e-234b-445e-81b7-370edca3fe2e tempest-VolumesDeleteCascade-906689606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:56 devstack sudo[88137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.info
Feb 28 04:44:56 devstack sudo[88137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:57 devstack sudo[88133]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:57 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9b4bf7c7-0b53-4d2b-ad74-8d638a51a633 tempest-VolumesActionsTest-4540298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 1.376s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:57 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-9b4bf7c7-0b53-4d2b-ad74-8d638a51a633 tempest-VolumesActionsTest-4540298 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:44:57 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-9b4bf7c7-0b53-4d2b-ad74-8d638a51a633 tempest-VolumesActionsTest-4540298 None] Deleted volume successfully.
Feb 28 04:44:57 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-9b4bf7c7-0b53-4d2b-ad74-8d638a51a633 tempest-VolumesActionsTest-4540298 None] Lock "cinder-fb282f2e-4d94-41e1-8db7-9e8c9000d1ac-delete_volume" released by "delete_volume" :: held 3.434s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:44:57 devstack sudo[88137]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:57 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-cfce089e-234b-445e-81b7-370edca3fe2e tempest-VolumesDeleteCascade-906689606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.info" returned: 0 in 0.982s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:57 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-cfce089e-234b-445e-81b7-370edca3fe2e tempest-VolumesDeleteCascade-906689606 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.info is being set with open permissions: ugo+rw
Feb 28 04:44:57 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-cfce089e-234b-445e-81b7-370edca3fe2e tempest-VolumesDeleteCascade-906689606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:57 devstack sudo[88167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.info
Feb 28 04:44:57 devstack sudo[88167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:44:58 devstack sudo[88167]: pam_unix(sudo:session): session closed for user root
Feb 28 04:44:58 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-cfce089e-234b-445e-81b7-370edca3fe2e tempest-VolumesDeleteCascade-906689606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.info" returned: 0 in 1.086s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:44:58 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-cfce089e-234b-445e-81b7-370edca3fe2e tempest-VolumesDeleteCascade-906689606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.819s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:44:58 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-cfce089e-234b-445e-81b7-370edca3fe2e tempest-VolumesDeleteCascade-906689606 None] Create snapshot completed successfully
Feb 28 04:44:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-147cdc37-a9d0-46e6-8e80-579375aa4e78 tempest-VolumesDeleteCascade-906689606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:44:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-147cdc37-a9d0-46e6-8e80-579375aa4e78 tempest-VolumesDeleteCascade-906689606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:44:59 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-147cdc37-a9d0-46e6-8e80-579375aa4e78 tempest-VolumesDeleteCascade-906689606 None] Creating offline snapshot bc28c30d-0470-453e-a458-bac143bff408 of volume 4307a7d9-674a-460c-857d-977b65d4fb9e {{(pid=84248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 04:44:59 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[d858bae5-e3f4-4055-b8dc-7e2b6732a46f]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:44:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-147cdc37-a9d0-46e6-8e80-579375aa4e78 tempest-VolumesDeleteCascade-906689606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.dd5e31bc-ae2d-47e4-a008-30c81dfdb2ed {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:44:59 devstack sudo[88201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.dd5e31bc-ae2d-47e4-a008-30c81dfdb2ed
Feb 28 04:44:59 devstack sudo[88201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:00 devstack sudo[88201]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-147cdc37-a9d0-46e6-8e80-579375aa4e78 tempest-VolumesDeleteCascade-906689606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.dd5e31bc-ae2d-47e4-a008-30c81dfdb2ed" returned: 0 in 0.737s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:00 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-147cdc37-a9d0-46e6-8e80-579375aa4e78 tempest-VolumesDeleteCascade-906689606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4307a7d9-674a-460c-857d-977b65d4fb9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:45:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-147cdc37-a9d0-46e6-8e80-579375aa4e78 tempest-VolumesDeleteCascade-906689606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.dd5e31bc-ae2d-47e4-a008-30c81dfdb2ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.bc28c30d-0470-453e-a458-bac143bff408 1G {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:00 devstack sudo[88215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.dd5e31bc-ae2d-47e4-a008-30c81dfdb2ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.bc28c30d-0470-453e-a458-bac143bff408 1G
Feb 28 04:45:00 devstack sudo[88215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:00 devstack sudo[88215]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-147cdc37-a9d0-46e6-8e80-579375aa4e78 tempest-VolumesDeleteCascade-906689606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.dd5e31bc-ae2d-47e4-a008-30c81dfdb2ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.bc28c30d-0470-453e-a458-bac143bff408 1G" returned: 0 in 0.648s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-147cdc37-a9d0-46e6-8e80-579375aa4e78 tempest-VolumesDeleteCascade-906689606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4307a7d9-674a-460c-857d-977b65d4fb9e.dd5e31bc-ae2d-47e4-a008-30c81dfdb2ed -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.bc28c30d-0470-453e-a458-bac143bff408 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:00 devstack sudo[88235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4307a7d9-674a-460c-857d-977b65d4fb9e.dd5e31bc-ae2d-47e4-a008-30c81dfdb2ed -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.bc28c30d-0470-453e-a458-bac143bff408
Feb 28 04:45:00 devstack sudo[88235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:01 devstack sudo[88235]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-147cdc37-a9d0-46e6-8e80-579375aa4e78 tempest-VolumesDeleteCascade-906689606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4307a7d9-674a-460c-857d-977b65d4fb9e.dd5e31bc-ae2d-47e4-a008-30c81dfdb2ed -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.bc28c30d-0470-453e-a458-bac143bff408" returned: 0 in 0.500s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:01 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-147cdc37-a9d0-46e6-8e80-579375aa4e78 tempest-VolumesDeleteCascade-906689606 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.bc28c30d-0470-453e-a458-bac143bff408 is being set with open permissions: ugo+rw
Feb 28 04:45:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-147cdc37-a9d0-46e6-8e80-579375aa4e78 tempest-VolumesDeleteCascade-906689606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.bc28c30d-0470-453e-a458-bac143bff408 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:01 devstack sudo[88240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.bc28c30d-0470-453e-a458-bac143bff408
Feb 28 04:45:01 devstack sudo[88240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:01 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-25059274-82c5-47c5-bff1-d76f935885c9 tempest-VolumesCloneTest-1972083399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:45:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-25059274-82c5-47c5-bff1-d76f935885c9 tempest-VolumesCloneTest-1972083399 None] Flow 'volume_create_manager' (8de7978f-d4b2-43b0-b12f-4dc2b735a0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:45:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-25059274-82c5-47c5-bff1-d76f935885c9 tempest-VolumesCloneTest-1972083399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c80d813d-67db-4197-bcb1-f87312d0d673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-25059274-82c5-47c5-bff1-d76f935885c9 tempest-VolumesCloneTest-1972083399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c80d813d-67db-4197-bcb1-f87312d0d673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1321908476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95f784e7-3ff4-449f-816d-0d336c5c641e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f70296c06d964142852f8783462d32cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:45:01Z,use_quota=True,user_id='00368302e1f24f2d935668bea2475bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-25059274-82c5-47c5-bff1-d76f935885c9 tempest-VolumesCloneTest-1972083399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e067a2ec-c5bc-4100-a4c3-68030ace096c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-25059274-82c5-47c5-bff1-d76f935885c9 tempest-VolumesCloneTest-1972083399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e067a2ec-c5bc-4100-a4c3-68030ace096c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-25059274-82c5-47c5-bff1-d76f935885c9 tempest-VolumesCloneTest-1972083399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7f6f86b-b932-46df-9e24-6a7e0865885f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-25059274-82c5-47c5-bff1-d76f935885c9 tempest-VolumesCloneTest-1972083399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7f6f86b-b932-46df-9e24-6a7e0865885f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95f784e7-3ff4-449f-816d-0d336c5c641e', 'volume_name': 'volume-95f784e7-3ff4-449f-816d-0d336c5c641e', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-25059274-82c5-47c5-bff1-d76f935885c9 tempest-VolumesCloneTest-1972083399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13118def-6c17-4557-ad07-3fad1e8d8c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-25059274-82c5-47c5-bff1-d76f935885c9 tempest-VolumesCloneTest-1972083399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13118def-6c17-4557-ad07-3fad1e8d8c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-25059274-82c5-47c5-bff1-d76f935885c9 tempest-VolumesCloneTest-1972083399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a428a5c2-d502-4682-b897-98e56a4302ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:01 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-25059274-82c5-47c5-bff1-d76f935885c9 tempest-VolumesCloneTest-1972083399 None] Volume 95f784e7-3ff4-449f-816d-0d336c5c641e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95f784e7-3ff4-449f-816d-0d336c5c641e', 'volume_size': 1}
Feb 28 04:45:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-25059274-82c5-47c5-bff1-d76f935885c9 tempest-VolumesCloneTest-1972083399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:01 devstack sudo[88240]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-147cdc37-a9d0-46e6-8e80-579375aa4e78 tempest-VolumesDeleteCascade-906689606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.bc28c30d-0470-453e-a458-bac143bff408" returned: 0 in 0.451s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-147cdc37-a9d0-46e6-8e80-579375aa4e78 tempest-VolumesDeleteCascade-906689606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.405s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-25059274-82c5-47c5-bff1-d76f935885c9 tempest-VolumesCloneTest-1972083399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.195s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:01 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-25059274-82c5-47c5-bff1-d76f935885c9 tempest-VolumesCloneTest-1972083399 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1321908476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95f784e7-3ff4-449f-816d-0d336c5c641e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f70296c06d964142852f8783462d32cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:45:01Z,use_quota=True,user_id='00368302e1f24f2d935668bea2475bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:45:01 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-25059274-82c5-47c5-bff1-d76f935885c9 tempest-VolumesCloneTest-1972083399 None] Creating volume 95f784e7-3ff4-449f-816d-0d336c5c641e {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:45:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-25059274-82c5-47c5-bff1-d76f935885c9 tempest-VolumesCloneTest-1972083399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-25059274-82c5-47c5-bff1-d76f935885c9 tempest-VolumesCloneTest-1972083399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:01 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-25059274-82c5-47c5-bff1-d76f935885c9 tempest-VolumesCloneTest-1972083399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:45:01 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-25059274-82c5-47c5-bff1-d76f935885c9 tempest-VolumesCloneTest-1972083399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:45:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-25059274-82c5-47c5-bff1-d76f935885c9 tempest-VolumesCloneTest-1972083399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:01 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-25059274-82c5-47c5-bff1-d76f935885c9 tempest-VolumesCloneTest-1972083399 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:45:01 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-25059274-82c5-47c5-bff1-d76f935885c9 tempest-VolumesCloneTest-1972083399 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:45:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-25059274-82c5-47c5-bff1-d76f935885c9 tempest-VolumesCloneTest-1972083399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:01 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-147cdc37-a9d0-46e6-8e80-579375aa4e78 tempest-VolumesDeleteCascade-906689606 None] Create snapshot completed successfully
Feb 28 04:45:01 devstack sudo[88243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e 1073741824
Feb 28 04:45:01 devstack sudo[88243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:02 devstack sudo[88243]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-25059274-82c5-47c5-bff1-d76f935885c9 tempest-VolumesCloneTest-1972083399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e 1073741824" returned: 0 in 0.565s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-25059274-82c5-47c5-bff1-d76f935885c9 tempest-VolumesCloneTest-1972083399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:02 devstack sudo[88248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e
Feb 28 04:45:02 devstack sudo[88248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:02 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Acquiring lock "cinder-4307a7d9-674a-460c-857d-977b65d4fb9e-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:02 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Lock "cinder-4307a7d9-674a-460c-857d-977b65d4fb9e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:02 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Performing cascade delete. {{(pid=84248) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Feb 28 04:45:02 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Acquiring lock "cinder-bc28c30d-0470-453e-a458-bac143bff408-delete_snapshot" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:02 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Lock "cinder-bc28c30d-0470-453e-a458-bac143bff408-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:02 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Acquiring lock "cinder-quobyte-4307a7d9-674a-460c-857d-977b65d4fb9e" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:02 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Lock "cinder-quobyte-4307a7d9-674a-460c-857d-977b65d4fb9e" acquired by "delete_snapshot" :: waited 0.007s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:02 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Acquiring lock "cinder-quobyte-bc28c30d-0470-453e-a458-bac143bff408" by "_delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:02 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Lock "cinder-quobyte-bc28c30d-0470-453e-a458-bac143bff408" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:02 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Deleting offline snapshot bc28c30d-0470-453e-a458-bac143bff408 of volume 4307a7d9-674a-460c-857d-977b65d4fb9e {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 04:45:02 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] snapshot_file for this snap is: volume-4307a7d9-674a-460c-857d-977b65d4fb9e.bc28c30d-0470-453e-a458-bac143bff408 {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 04:45:02 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[764f7df9-c31c-4cf5-8e6c-866aac13aa2b]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.bc28c30d-0470-453e-a458-bac143bff408 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:02 devstack sudo[88250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.bc28c30d-0470-453e-a458-bac143bff408
Feb 28 04:45:02 devstack sudo[88250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:02 devstack sudo[88248]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-25059274-82c5-47c5-bff1-d76f935885c9 tempest-VolumesCloneTest-1972083399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e" returned: 0 in 0.431s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:02 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-25059274-82c5-47c5-bff1-d76f935885c9 tempest-VolumesCloneTest-1972083399 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:45:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-25059274-82c5-47c5-bff1-d76f935885c9 tempest-VolumesCloneTest-1972083399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:02 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-25059274-82c5-47c5-bff1-d76f935885c9 tempest-VolumesCloneTest-1972083399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a428a5c2-d502-4682-b897-98e56a4302ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95f784e7-3ff4-449f-816d-0d336c5c641e', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:02 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-25059274-82c5-47c5-bff1-d76f935885c9 tempest-VolumesCloneTest-1972083399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74a8bbb4-4e57-4e84-9855-980f26887ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:02 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-25059274-82c5-47c5-bff1-d76f935885c9 tempest-VolumesCloneTest-1972083399 None] Volume volume-95f784e7-3ff4-449f-816d-0d336c5c641e (95f784e7-3ff4-449f-816d-0d336c5c641e): created successfully
Feb 28 04:45:02 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-25059274-82c5-47c5-bff1-d76f935885c9 tempest-VolumesCloneTest-1972083399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74a8bbb4-4e57-4e84-9855-980f26887ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:02 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-25059274-82c5-47c5-bff1-d76f935885c9 tempest-VolumesCloneTest-1972083399 None] Flow 'volume_create_manager' (8de7978f-d4b2-43b0-b12f-4dc2b735a0ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:45:02 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-25059274-82c5-47c5-bff1-d76f935885c9 tempest-VolumesCloneTest-1972083399 None] Created volume successfully.
Feb 28 04:45:02 devstack sudo[88250]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.bc28c30d-0470-453e-a458-bac143bff408" returned: 0 in 0.466s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:02 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4307a7d9-674a-460c-857d-977b65d4fb9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:45:02 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6ae7d4-7438-446a-b2e8-6d707f585071]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.dd5e31bc-ae2d-47e4-a008-30c81dfdb2ed {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:03 devstack sudo[88256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.dd5e31bc-ae2d-47e4-a008-30c81dfdb2ed
Feb 28 04:45:03 devstack sudo[88256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:03 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-164615f8-80c0-4dc8-a8e3-5ef6e8ed2786 tempest-VolumesActionsTest-4540298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:45:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-164615f8-80c0-4dc8-a8e3-5ef6e8ed2786 tempest-VolumesActionsTest-4540298 None] Flow 'volume_create_manager' (ff87c76b-b73d-4f4c-9e2c-03a7a97c653b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:45:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-164615f8-80c0-4dc8-a8e3-5ef6e8ed2786 tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7b2acd8-d7ea-4d63-83ab-cdb2c879b6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-164615f8-80c0-4dc8-a8e3-5ef6e8ed2786 tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7b2acd8-d7ea-4d63-83ab-cdb2c879b6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-887731884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9817882c-97ac-4666-bfd4-4416b68946c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af27b7a098294a58b84dd04067ce0e24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:45:03Z,use_quota=True,user_id='4e66d3f79b074645a4e80b9f7a373a42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-164615f8-80c0-4dc8-a8e3-5ef6e8ed2786 tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cb4a23e-053f-456e-abbf-5746786b3c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-164615f8-80c0-4dc8-a8e3-5ef6e8ed2786 tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cb4a23e-053f-456e-abbf-5746786b3c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-164615f8-80c0-4dc8-a8e3-5ef6e8ed2786 tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb25cbb-7315-483b-a0d2-6f89091e9872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-164615f8-80c0-4dc8-a8e3-5ef6e8ed2786 tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb25cbb-7315-483b-a0d2-6f89091e9872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9817882c-97ac-4666-bfd4-4416b68946c6', 'volume_name': 'volume-9817882c-97ac-4666-bfd4-4416b68946c6', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-164615f8-80c0-4dc8-a8e3-5ef6e8ed2786 tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bdf9357-6129-49b5-b4bc-9d5f40a3b69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-164615f8-80c0-4dc8-a8e3-5ef6e8ed2786 tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bdf9357-6129-49b5-b4bc-9d5f40a3b69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-164615f8-80c0-4dc8-a8e3-5ef6e8ed2786 tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0a4bd14-5224-4826-980f-299717f0b198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:03 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-164615f8-80c0-4dc8-a8e3-5ef6e8ed2786 tempest-VolumesActionsTest-4540298 None] Volume 9817882c-97ac-4666-bfd4-4416b68946c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9817882c-97ac-4666-bfd4-4416b68946c6', 'volume_size': 1}
Feb 28 04:45:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-164615f8-80c0-4dc8-a8e3-5ef6e8ed2786 tempest-VolumesActionsTest-4540298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-164615f8-80c0-4dc8-a8e3-5ef6e8ed2786 tempest-VolumesActionsTest-4540298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:03 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-164615f8-80c0-4dc8-a8e3-5ef6e8ed2786 tempest-VolumesActionsTest-4540298 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-887731884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9817882c-97ac-4666-bfd4-4416b68946c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af27b7a098294a58b84dd04067ce0e24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:45:03Z,use_quota=True,user_id='4e66d3f79b074645a4e80b9f7a373a42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:45:03 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-164615f8-80c0-4dc8-a8e3-5ef6e8ed2786 tempest-VolumesActionsTest-4540298 None] Creating volume 9817882c-97ac-4666-bfd4-4416b68946c6 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:45:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-164615f8-80c0-4dc8-a8e3-5ef6e8ed2786 tempest-VolumesActionsTest-4540298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-164615f8-80c0-4dc8-a8e3-5ef6e8ed2786 tempest-VolumesActionsTest-4540298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:03 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-164615f8-80c0-4dc8-a8e3-5ef6e8ed2786 tempest-VolumesActionsTest-4540298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:45:03 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-164615f8-80c0-4dc8-a8e3-5ef6e8ed2786 tempest-VolumesActionsTest-4540298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:45:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-164615f8-80c0-4dc8-a8e3-5ef6e8ed2786 tempest-VolumesActionsTest-4540298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:03 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-164615f8-80c0-4dc8-a8e3-5ef6e8ed2786 tempest-VolumesActionsTest-4540298 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:45:03 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-164615f8-80c0-4dc8-a8e3-5ef6e8ed2786 tempest-VolumesActionsTest-4540298 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:45:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-164615f8-80c0-4dc8-a8e3-5ef6e8ed2786 tempest-VolumesActionsTest-4540298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9817882c-97ac-4666-bfd4-4416b68946c6 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:03 devstack sudo[88260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9817882c-97ac-4666-bfd4-4416b68946c6 1073741824
Feb 28 04:45:03 devstack sudo[88260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:03 devstack sudo[88256]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.dd5e31bc-ae2d-47e4-a008-30c81dfdb2ed" returned: 0 in 0.635s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:03 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4307a7d9-674a-460c-857d-977b65d4fb9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:45:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.bc28c30d-0470-453e-a458-bac143bff408 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:03 devstack sudo[88263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.bc28c30d-0470-453e-a458-bac143bff408
Feb 28 04:45:03 devstack sudo[88263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:03 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:45:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Flow 'volume_create_manager' (a8bb657f-50b6-42c0-898c-69e884512ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:45:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32598d28-a9b0-4a3c-8c8b-9e2702012750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32598d28-a9b0-4a3c-8c8b-9e2702012750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-161969247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3e925af-4443-43b5-8c0d-50047ac7592a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f70296c06d964142852f8783462d32cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:45:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=95f784e7-3ff4-449f-816d-0d336c5c641e,status='creating',terminated_at=None,updated_at=2026-02-28T03:45:04Z,use_quota=True,user_id='00368302e1f24f2d935668bea2475bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edeea65c-59ea-492e-abaa-5119fa7a7050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edeea65c-59ea-492e-abaa-5119fa7a7050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d3a527a-8605-4703-8c19-a1225cc74299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d3a527a-8605-4703-8c19-a1225cc74299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e3e925af-4443-43b5-8c0d-50047ac7592a', 'volume_name': 'volume-e3e925af-4443-43b5-8c0d-50047ac7592a', 'volume_size': 2, 'source_volid': '95f784e7-3ff4-449f-816d-0d336c5c641e', 'source_volstatus': 'available'}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e06c253e-9d8b-4b44-83a0-4f10996e1d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e06c253e-9d8b-4b44-83a0-4f10996e1d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9948204-853d-41ce-9b4f-97c3e2d87d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:03 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Volume e3e925af-4443-43b5-8c0d-50047ac7592a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e3e925af-4443-43b5-8c0d-50047ac7592a', 'volume_size': 2, 'source_volid': '95f784e7-3ff4-449f-816d-0d336c5c641e', 'source_volstatus': 'available'}
Feb 28 04:45:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:04 devstack sudo[88260]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-164615f8-80c0-4dc8-a8e3-5ef6e8ed2786 tempest-VolumesActionsTest-4540298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9817882c-97ac-4666-bfd4-4416b68946c6 1073741824" returned: 0 in 0.656s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-164615f8-80c0-4dc8-a8e3-5ef6e8ed2786 tempest-VolumesActionsTest-4540298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9817882c-97ac-4666-bfd4-4416b68946c6 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:04 devstack sudo[88271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9817882c-97ac-4666-bfd4-4416b68946c6
Feb 28 04:45:04 devstack sudo[88271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:04 devstack sudo[88263]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.bc28c30d-0470-453e-a458-bac143bff408" returned: 0 in 0.571s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.bc28c30d-0470-453e-a458-bac143bff408 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:04 devstack sudo[88273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.bc28c30d-0470-453e-a458-bac143bff408
Feb 28 04:45:04 devstack sudo[88273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:04 devstack sudo[88271]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-164615f8-80c0-4dc8-a8e3-5ef6e8ed2786 tempest-VolumesActionsTest-4540298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9817882c-97ac-4666-bfd4-4416b68946c6" returned: 0 in 0.531s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:04 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-164615f8-80c0-4dc8-a8e3-5ef6e8ed2786 tempest-VolumesActionsTest-4540298 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:45:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-164615f8-80c0-4dc8-a8e3-5ef6e8ed2786 tempest-VolumesActionsTest-4540298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:04 devstack sudo[88273]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.718s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:04 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Cloning volume 95f784e7-3ff4-449f-816d-0d336c5c641e to volume e3e925af-4443-43b5-8c0d-50047ac7592a
Feb 28 04:45:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-164615f8-80c0-4dc8-a8e3-5ef6e8ed2786 tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0a4bd14-5224-4826-980f-299717f0b198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9817882c-97ac-4666-bfd4-4416b68946c6', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-164615f8-80c0-4dc8-a8e3-5ef6e8ed2786 tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4eeb695-49b3-4cd4-a226-86d23ecf33db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.bc28c30d-0470-453e-a458-bac143bff408" returned: 0 in 0.528s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:04 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-164615f8-80c0-4dc8-a8e3-5ef6e8ed2786 tempest-VolumesActionsTest-4540298 None] Volume volume-9817882c-97ac-4666-bfd4-4416b68946c6 (9817882c-97ac-4666-bfd4-4416b68946c6): created successfully
Feb 28 04:45:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-164615f8-80c0-4dc8-a8e3-5ef6e8ed2786 tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4eeb695-49b3-4cd4-a226-86d23ecf33db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-164615f8-80c0-4dc8-a8e3-5ef6e8ed2786 tempest-VolumesActionsTest-4540298 None] Flow 'volume_create_manager' (ff87c76b-b73d-4f4c-9e2c-03a7a97c653b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:45:04 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Lock "cinder-quobyte-bc28c30d-0470-453e-a458-bac143bff408" released by "_delete_snapshot" :: held 2.285s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:04 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Lock "cinder-quobyte-4307a7d9-674a-460c-857d-977b65d4fb9e" released by "delete_snapshot" :: held 2.319s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:04 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-164615f8-80c0-4dc8-a8e3-5ef6e8ed2786 tempest-VolumesActionsTest-4540298 None] Created volume successfully.
Feb 28 04:45:04 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac6754d6-762f-46e4-af38-3e5df67c895d tempest-ServersNegativeTestJSON-2118949871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:45:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ac6754d6-762f-46e4-af38-3e5df67c895d tempest-ServersNegativeTestJSON-2118949871 None] Flow 'volume_create_manager' (e2b16ac2-0520-443f-b572-60bfe537dde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:45:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ac6754d6-762f-46e4-af38-3e5df67c895d tempest-ServersNegativeTestJSON-2118949871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b09b0a6a-4998-491a-8826-9d58eef6a562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:04 devstack cinder-volume[84248]: DEBUG dbcounter [-] [84248] Writing DB stats cinder:UPDATE=164,cinder:SELECT=123,cinder:DELETE=12,cinder:INSERT=31 {{(pid=84248) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 04:45:04 devstack cinder-volume[84248]: DEBUG dbcounter [-] [84248] Writing DB stats cinder:SELECT=114,cinder:UPDATE=132,cinder:INSERT=40,cinder:DELETE=16 {{(pid=84248) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 04:45:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ac6754d6-762f-46e4-af38-3e5df67c895d tempest-ServersNegativeTestJSON-2118949871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b09b0a6a-4998-491a-8826-9d58eef6a562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1101703265',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1785cafa-1e40-416c-991d-e65364487353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bd6dd70b2643a6a531c361c9879e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:45:05Z,use_quota=True,user_id='cac10434d704410196cb5808ee6f4963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ac6754d6-762f-46e4-af38-3e5df67c895d tempest-ServersNegativeTestJSON-2118949871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79583a44-5753-4077-b6de-82773de1724a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ac6754d6-762f-46e4-af38-3e5df67c895d tempest-ServersNegativeTestJSON-2118949871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79583a44-5753-4077-b6de-82773de1724a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ac6754d6-762f-46e4-af38-3e5df67c895d tempest-ServersNegativeTestJSON-2118949871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fc34c16-d35f-4a4b-a634-1358643110d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ac6754d6-762f-46e4-af38-3e5df67c895d tempest-ServersNegativeTestJSON-2118949871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fc34c16-d35f-4a4b-a634-1358643110d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1785cafa-1e40-416c-991d-e65364487353', 'volume_name': 'volume-1785cafa-1e40-416c-991d-e65364487353', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ac6754d6-762f-46e4-af38-3e5df67c895d tempest-ServersNegativeTestJSON-2118949871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1156298-399d-4d80-8b3e-fdb998e62a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ac6754d6-762f-46e4-af38-3e5df67c895d tempest-ServersNegativeTestJSON-2118949871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1156298-399d-4d80-8b3e-fdb998e62a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ac6754d6-762f-46e4-af38-3e5df67c895d tempest-ServersNegativeTestJSON-2118949871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4567a685-959d-41dc-927d-8d156c054c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:04 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-ac6754d6-762f-46e4-af38-3e5df67c895d tempest-ServersNegativeTestJSON-2118949871 None] Volume 1785cafa-1e40-416c-991d-e65364487353: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1785cafa-1e40-416c-991d-e65364487353', 'volume_size': 1}
Feb 28 04:45:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ac6754d6-762f-46e4-af38-3e5df67c895d tempest-ServersNegativeTestJSON-2118949871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:04 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Creating offline snapshot 6e458977-fb8a-4f2a-a0cd-b567beb943bc of volume 95f784e7-3ff4-449f-816d-0d336c5c641e {{(pid=84248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 04:45:04 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5e3258-1e46-4e69-91a4-ec0098ee728f]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:04 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Created reservations ['7bdfe546-5faf-4d4c-90f2-fc83550a0fa0', 'cc57b452-0017-4338-a017-4b14e5862a3d', '2ec621ac-49e7-47a0-87c7-16496b15c5c4', '1780dde1-5fbc-452b-a07d-802f730839fe'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:45:04 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Delete snapshot completed successfully.
Feb 28 04:45:04 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Lock "cinder-bc28c30d-0470-453e-a458-bac143bff408-delete_snapshot" released by "delete_snapshot" :: held 2.521s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:04 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Acquiring lock "cinder-dd5e31bc-ae2d-47e4-a008-30c81dfdb2ed-delete_snapshot" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:04 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Lock "cinder-dd5e31bc-ae2d-47e4-a008-30c81dfdb2ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:05 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Acquiring lock "cinder-quobyte-4307a7d9-674a-460c-857d-977b65d4fb9e" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:05 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Lock "cinder-quobyte-4307a7d9-674a-460c-857d-977b65d4fb9e" acquired by "delete_snapshot" :: waited 0.007s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:05 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Acquiring lock "cinder-quobyte-dd5e31bc-ae2d-47e4-a008-30c81dfdb2ed" by "_delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:05 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Lock "cinder-quobyte-dd5e31bc-ae2d-47e4-a008-30c81dfdb2ed" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:05 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Deleting offline snapshot dd5e31bc-ae2d-47e4-a008-30c81dfdb2ed of volume 4307a7d9-674a-460c-857d-977b65d4fb9e {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 04:45:05 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] snapshot_file for this snap is: volume-4307a7d9-674a-460c-857d-977b65d4fb9e.dd5e31bc-ae2d-47e4-a008-30c81dfdb2ed {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 04:45:05 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba5cb54-a74d-458c-ae41-7df18758e1b8]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.dd5e31bc-ae2d-47e4-a008-30c81dfdb2ed {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:05 devstack sudo[88278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e
Feb 28 04:45:05 devstack sudo[88278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:05 devstack sudo[88279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.dd5e31bc-ae2d-47e4-a008-30c81dfdb2ed
Feb 28 04:45:05 devstack sudo[88279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:05 devstack sudo[88278]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e" returned: 0 in 0.485s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e.6e458977-fb8a-4f2a-a0cd-b567beb943bc 1G {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:05 devstack sudo[88285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e.6e458977-fb8a-4f2a-a0cd-b567beb943bc 1G
Feb 28 04:45:05 devstack sudo[88285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:05 devstack sudo[88279]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.dd5e31bc-ae2d-47e4-a008-30c81dfdb2ed" returned: 0 in 0.499s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:05 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4307a7d9-674a-460c-857d-977b65d4fb9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:45:05 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c1dcc3-ec04-4de4-bda3-c5afe7d012f0]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:05 devstack sudo[88290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e
Feb 28 04:45:05 devstack sudo[88290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:05 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1309a296-88ce-41a2-b8b2-b1a0b8c3dc0d tempest-VolumesActionsTest-275771739 None] Acquiring lock "cinder-9817882c-97ac-4666-bfd4-4416b68946c6-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:05 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1309a296-88ce-41a2-b8b2-b1a0b8c3dc0d tempest-VolumesActionsTest-275771739 None] Lock "cinder-9817882c-97ac-4666-bfd4-4416b68946c6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:05 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1309a296-88ce-41a2-b8b2-b1a0b8c3dc0d tempest-VolumesActionsTest-275771739 None] Acquiring lock "cinder-quobyte-9817882c-97ac-4666-bfd4-4416b68946c6" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:05 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1309a296-88ce-41a2-b8b2-b1a0b8c3dc0d tempest-VolumesActionsTest-275771739 None] Lock "cinder-quobyte-9817882c-97ac-4666-bfd4-4416b68946c6" acquired by "delete_volume" :: waited 0.008s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:05 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[03267e79-25dd-4f08-98b8-70a8f3277c2f]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1309a296-88ce-41a2-b8b2-b1a0b8c3dc0d tempest-VolumesActionsTest-275771739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9817882c-97ac-4666-bfd4-4416b68946c6 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:05 devstack sudo[88295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9817882c-97ac-4666-bfd4-4416b68946c6
Feb 28 04:45:05 devstack sudo[88295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:05 devstack sudo[88285]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e.6e458977-fb8a-4f2a-a0cd-b567beb943bc 1G" returned: 0 in 0.547s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95f784e7-3ff4-449f-816d-0d336c5c641e -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e.6e458977-fb8a-4f2a-a0cd-b567beb943bc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:05 devstack sudo[88297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95f784e7-3ff4-449f-816d-0d336c5c641e -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e.6e458977-fb8a-4f2a-a0cd-b567beb943bc
Feb 28 04:45:05 devstack sudo[88297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:06 devstack sudo[88290]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e" returned: 0 in 0.640s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.dd5e31bc-ae2d-47e4-a008-30c81dfdb2ed {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:06 devstack sudo[88302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.dd5e31bc-ae2d-47e4-a008-30c81dfdb2ed
Feb 28 04:45:06 devstack sudo[88302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:06 devstack sudo[88295]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1309a296-88ce-41a2-b8b2-b1a0b8c3dc0d tempest-VolumesActionsTest-275771739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9817882c-97ac-4666-bfd4-4416b68946c6" returned: 0 in 0.518s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1309a296-88ce-41a2-b8b2-b1a0b8c3dc0d tempest-VolumesActionsTest-275771739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9817882c-97ac-4666-bfd4-4416b68946c6 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:06 devstack sudo[88309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9817882c-97ac-4666-bfd4-4416b68946c6
Feb 28 04:45:06 devstack sudo[88309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:06 devstack sudo[88297]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95f784e7-3ff4-449f-816d-0d336c5c641e -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e.6e458977-fb8a-4f2a-a0cd-b567beb943bc" returned: 0 in 0.464s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:06 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e.6e458977-fb8a-4f2a-a0cd-b567beb943bc is being set with open permissions: ugo+rw
Feb 28 04:45:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e.6e458977-fb8a-4f2a-a0cd-b567beb943bc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:06 devstack sudo[88312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e.6e458977-fb8a-4f2a-a0cd-b567beb943bc
Feb 28 04:45:06 devstack sudo[88312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:06 devstack sudo[88302]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.dd5e31bc-ae2d-47e4-a008-30c81dfdb2ed" returned: 0 in 0.487s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.dd5e31bc-ae2d-47e4-a008-30c81dfdb2ed {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:06 devstack sudo[88318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.dd5e31bc-ae2d-47e4-a008-30c81dfdb2ed
Feb 28 04:45:06 devstack sudo[88318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:06 devstack sudo[88309]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1309a296-88ce-41a2-b8b2-b1a0b8c3dc0d tempest-VolumesActionsTest-275771739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9817882c-97ac-4666-bfd4-4416b68946c6" returned: 0 in 0.393s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:06 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1309a296-88ce-41a2-b8b2-b1a0b8c3dc0d tempest-VolumesActionsTest-275771739 None] Lock "cinder-quobyte-9817882c-97ac-4666-bfd4-4416b68946c6" released by "delete_volume" :: held 0.938s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:06 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-1309a296-88ce-41a2-b8b2-b1a0b8c3dc0d tempest-VolumesActionsTest-275771739 None] Created reservations ['2d51a609-3a7f-4bab-ba58-59403ce44e8b', '55013c05-82f4-42fb-8c6e-13059a44c40e', '0ebfb904-4456-41fe-b1a0-9dd2627d223b', '42d54546-bebb-4cdd-87d1-96171de4bf92'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:45:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-1309a296-88ce-41a2-b8b2-b1a0b8c3dc0d tempest-VolumesActionsTest-275771739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-1309a296-88ce-41a2-b8b2-b1a0b8c3dc0d tempest-VolumesActionsTest-275771739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:06 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-1309a296-88ce-41a2-b8b2-b1a0b8c3dc0d tempest-VolumesActionsTest-275771739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:45:06 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-1309a296-88ce-41a2-b8b2-b1a0b8c3dc0d tempest-VolumesActionsTest-275771739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:45:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-1309a296-88ce-41a2-b8b2-b1a0b8c3dc0d tempest-VolumesActionsTest-275771739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1309a296-88ce-41a2-b8b2-b1a0b8c3dc0d tempest-VolumesActionsTest-275771739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:06 devstack sudo[88321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:45:06 devstack sudo[88321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:06 devstack sudo[88312]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e.6e458977-fb8a-4f2a-a0cd-b567beb943bc" returned: 0 in 0.503s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:07 devstack sudo[88323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e.info
Feb 28 04:45:07 devstack sudo[88323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:07 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-44155747-7bc9-4722-85fe-0cdbeed0246e tempest-VolumesActionsTest-4540298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:45:07 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-44155747-7bc9-4722-85fe-0cdbeed0246e tempest-VolumesActionsTest-4540298 None] Flow 'volume_create_manager' (fcd0d6f2-f086-4dc4-91e4-b9f4cf1dbae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:45:07 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-44155747-7bc9-4722-85fe-0cdbeed0246e tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2c48309-380a-49cf-9aa2-50c64de10883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:07 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-44155747-7bc9-4722-85fe-0cdbeed0246e tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2c48309-380a-49cf-9aa2-50c64de10883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1678715545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ab3fd41-83b6-472a-985a-a1eb467ce559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af27b7a098294a58b84dd04067ce0e24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:45:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:45:07Z,use_quota=True,user_id='4e66d3f79b074645a4e80b9f7a373a42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:07 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-44155747-7bc9-4722-85fe-0cdbeed0246e tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef13cb39-41c2-4520-8fee-4e8c26ed996d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:07 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-44155747-7bc9-4722-85fe-0cdbeed0246e tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef13cb39-41c2-4520-8fee-4e8c26ed996d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:07 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-44155747-7bc9-4722-85fe-0cdbeed0246e tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d88739f7-1ad6-49b4-91f8-e0f0f4b73929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:07 devstack sudo[88321]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:07 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-44155747-7bc9-4722-85fe-0cdbeed0246e tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d88739f7-1ad6-49b4-91f8-e0f0f4b73929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ab3fd41-83b6-472a-985a-a1eb467ce559', 'volume_name': 'volume-5ab3fd41-83b6-472a-985a-a1eb467ce559', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:07 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-44155747-7bc9-4722-85fe-0cdbeed0246e tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a78add4e-ffc4-4c4f-9f0e-bf751f63cf10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:07 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-44155747-7bc9-4722-85fe-0cdbeed0246e tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a78add4e-ffc4-4c4f-9f0e-bf751f63cf10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:07 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-44155747-7bc9-4722-85fe-0cdbeed0246e tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d444664e-2548-4f3f-bbc5-fa55527381f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:07 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-44155747-7bc9-4722-85fe-0cdbeed0246e tempest-VolumesActionsTest-4540298 None] Volume 5ab3fd41-83b6-472a-985a-a1eb467ce559: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ab3fd41-83b6-472a-985a-a1eb467ce559', 'volume_size': 1}
Feb 28 04:45:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-44155747-7bc9-4722-85fe-0cdbeed0246e tempest-VolumesActionsTest-4540298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1309a296-88ce-41a2-b8b2-b1a0b8c3dc0d tempest-VolumesActionsTest-275771739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.565s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:07 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-1309a296-88ce-41a2-b8b2-b1a0b8c3dc0d tempest-VolumesActionsTest-275771739 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:45:07 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-1309a296-88ce-41a2-b8b2-b1a0b8c3dc0d tempest-VolumesActionsTest-275771739 None] Deleted volume successfully.
Feb 28 04:45:07 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1309a296-88ce-41a2-b8b2-b1a0b8c3dc0d tempest-VolumesActionsTest-275771739 None] Lock "cinder-9817882c-97ac-4666-bfd4-4416b68946c6-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:07 devstack sudo[88318]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e.dd5e31bc-ae2d-47e4-a008-30c81dfdb2ed" returned: 0 in 0.733s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:07 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Lock "cinder-quobyte-dd5e31bc-ae2d-47e4-a008-30c81dfdb2ed" released by "_delete_snapshot" :: held 2.402s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:07 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Lock "cinder-quobyte-4307a7d9-674a-460c-857d-977b65d4fb9e" released by "delete_snapshot" :: held 2.414s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:07 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Created reservations ['e70a4de6-451b-46f9-9886-e8fbf87bddc2', 'a88cdcf6-d30f-4818-acb9-a9b6a1026c44', '8864c0aa-b7e0-4e8a-acd9-ee58aa940bcc', 'f41070ff-31ba-46a2-b827-0dc416d465da'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:45:07 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Delete snapshot completed successfully.
Feb 28 04:45:07 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Lock "cinder-dd5e31bc-ae2d-47e4-a008-30c81dfdb2ed-delete_snapshot" released by "delete_snapshot" :: held 2.504s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:07 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Snapshots deleted, issuing volume delete {{(pid=84248) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Feb 28 04:45:07 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Acquiring lock "cinder-quobyte-4307a7d9-674a-460c-857d-977b65d4fb9e" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:07 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Lock "cinder-quobyte-4307a7d9-674a-460c-857d-977b65d4fb9e" acquired by "delete_volume" :: waited 0.010s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:07 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[29836ba5-b08d-4f08-be99-813cdef18995]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:07 devstack sudo[88323]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e.info" returned: 0 in 0.631s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:07 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e.info is being set with open permissions: ugo+rw
Feb 28 04:45:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:07 devstack sudo[88328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e
Feb 28 04:45:07 devstack sudo[88328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:07 devstack sudo[88329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e.info
Feb 28 04:45:07 devstack sudo[88329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:08 devstack sudo[88329]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e.info" returned: 0 in 0.432s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:08 devstack sudo[88328]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:08 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Acquiring lock "cinder-quobyte-e3e925af-4443-43b5-8c0d-50047ac7592a" by "_copy_volume_from_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e" returned: 0 in 0.516s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:08 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Lock "cinder-quobyte-e3e925af-4443-43b5-8c0d-50047ac7592a" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:08 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] snapshot: 6e458977-fb8a-4f2a-a0cd-b567beb943bc, volume: e3e925af-4443-43b5-8c0d-50047ac7592a,  {{(pid=84248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 28 04:45:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:08 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:45:08 devstack sudo[88336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e
Feb 28 04:45:08 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:45:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:08 devstack sudo[88336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:08 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d64af6-c0b9-4f1a-8a27-75db12484978]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e.6e458977-fb8a-4f2a-a0cd-b567beb943bc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:08 devstack sudo[88338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e.6e458977-fb8a-4f2a-a0cd-b567beb943bc
Feb 28 04:45:08 devstack sudo[88338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:08 devstack sudo[88336]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4307a7d9-674a-460c-857d-977b65d4fb9e" returned: 0 in 0.415s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:08 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Lock "cinder-quobyte-4307a7d9-674a-460c-857d-977b65d4fb9e" released by "delete_volume" :: held 0.959s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:08 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Created reservations ['7b22486c-481a-4ae8-8dc9-9cec44211e7b', '1fc333ac-c1b9-4d46-a5c5-d8f4952e831d', 'e1e40008-3faa-4e88-892d-de5788879cd3', '91341c0a-150a-4099-9664-0dfec65b9c1c'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:45:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:08 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:45:08 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:45:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:08 devstack sudo[88338]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e.6e458977-fb8a-4f2a-a0cd-b567beb943bc" returned: 0 in 0.488s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:08 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95f784e7-3ff4-449f-816d-0d336c5c641e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:45:08 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] will copy from snapshot at /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e {{(pid=84248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 28 04:45:08 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Creating direct copy from snapshot {{(pid=84248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 28 04:45:08 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd1ad3d-1964-40c3-9a78-c30af5d4cb3e]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:08 devstack sudo[88344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:45:08 devstack sudo[88344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:08 devstack sudo[88346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e
Feb 28 04:45:08 devstack sudo[88346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:08 devstack sudo[88344]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.421s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:08 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:45:08 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Deleted volume successfully.
Feb 28 04:45:08 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-148fa191-b25e-401e-bc2d-ebcaed81e360 tempest-VolumesDeleteCascade-906689606 None] Lock "cinder-4307a7d9-674a-460c-857d-977b65d4fb9e-delete_volume" released by "delete_volume" :: held 6.570s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:09 devstack sudo[88346]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:09 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e" returned: 0 in 0.495s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:09 devstack cinder-volume[84248]: DEBUG cinder.utils [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Path /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e3e925af-4443-43b5-8c0d-50047ac7592a not found in is_blk_device check {{(pid=84248) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 28 04:45:09 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e3e925af-4443-43b5-8c0d-50047ac7592a {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:09 devstack sudo[88352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e3e925af-4443-43b5-8c0d-50047ac7592a
Feb 28 04:45:09 devstack sudo[88352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:09 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-f316161f-35c3-425a-8ade-62baef02d893 tempest-VolumesDeleteCascade-906689606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:45:09 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-f316161f-35c3-425a-8ade-62baef02d893 tempest-VolumesDeleteCascade-906689606 None] Flow 'volume_create_manager' (da5c3521-77c8-4c50-a188-6fd99927390d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:45:09 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-f316161f-35c3-425a-8ade-62baef02d893 tempest-VolumesDeleteCascade-906689606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e7ab073-a880-4b99-a184-04193341e486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:09 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-f316161f-35c3-425a-8ade-62baef02d893 tempest-VolumesDeleteCascade-906689606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e7ab073-a880-4b99-a184-04193341e486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1748825654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6456e9be-064e-4b81-8778-ce4c4a7fe56f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f56b2178a364e9eaa85d0a224a2ce79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:45:09Z,use_quota=True,user_id='ea39a12c50304676a7627a0ff3e77341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:09 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-f316161f-35c3-425a-8ade-62baef02d893 tempest-VolumesDeleteCascade-906689606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb39431c-f51f-4e54-99be-63f0417e740f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:09 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-f316161f-35c3-425a-8ade-62baef02d893 tempest-VolumesDeleteCascade-906689606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb39431c-f51f-4e54-99be-63f0417e740f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:09 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-f316161f-35c3-425a-8ade-62baef02d893 tempest-VolumesDeleteCascade-906689606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aba1b8f0-beaa-4ba1-b6c6-428d915849f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:09 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-f316161f-35c3-425a-8ade-62baef02d893 tempest-VolumesDeleteCascade-906689606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aba1b8f0-beaa-4ba1-b6c6-428d915849f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6456e9be-064e-4b81-8778-ce4c4a7fe56f', 'volume_name': 'volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:09 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-f316161f-35c3-425a-8ade-62baef02d893 tempest-VolumesDeleteCascade-906689606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c0fc3ea-5f14-467e-80eb-69b39e1a8e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:09 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-f316161f-35c3-425a-8ade-62baef02d893 tempest-VolumesDeleteCascade-906689606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c0fc3ea-5f14-467e-80eb-69b39e1a8e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:09 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-f316161f-35c3-425a-8ade-62baef02d893 tempest-VolumesDeleteCascade-906689606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75c76eb4-f153-404e-b9c0-91a54a1bdde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:09 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-f316161f-35c3-425a-8ade-62baef02d893 tempest-VolumesDeleteCascade-906689606 None] Volume 6456e9be-064e-4b81-8778-ce4c4a7fe56f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f', 'volume_size': 1}
Feb 28 04:45:09 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-f316161f-35c3-425a-8ade-62baef02d893 tempest-VolumesDeleteCascade-906689606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:11 devstack sudo[88352]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e3e925af-4443-43b5-8c0d-50047ac7592a" returned: 0 in 2.214s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:11 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68fb6f0-8dea-4818-930e-2b196ecdcee6]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:11 devstack sudo[88366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e
Feb 28 04:45:11 devstack sudo[88366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:11 devstack sudo[88366]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e" returned: 0 in 0.575s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:11 devstack cinder-volume[84248]: DEBUG cinder.image.image_utils [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Image conversion details: src /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e, size 1024.00 MB, duration 2.21 sec, destination /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e3e925af-4443-43b5-8c0d-50047ac7592a {{(pid=84248) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 28 04:45:11 devstack cinder-volume[84248]: INFO cinder.image.image_utils [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Converted 1024.00 MB image at 462.36 MB/s
Feb 28 04:45:11 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e3e925af-4443-43b5-8c0d-50047ac7592a is being set with open permissions: ugo+rw
Feb 28 04:45:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e3e925af-4443-43b5-8c0d-50047ac7592a {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:11 devstack sudo[88371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e3e925af-4443-43b5-8c0d-50047ac7592a
Feb 28 04:45:11 devstack sudo[88371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:12 devstack sudo[88371]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e3e925af-4443-43b5-8c0d-50047ac7592a" returned: 0 in 0.414s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:12 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Lock "cinder-quobyte-e3e925af-4443-43b5-8c0d-50047ac7592a" released by "_copy_volume_from_snapshot" :: held 4.233s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:12 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Acquiring lock "cinder-quobyte-6e458977-fb8a-4f2a-a0cd-b567beb943bc" by "_delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:12 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Lock "cinder-quobyte-6e458977-fb8a-4f2a-a0cd-b567beb943bc" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:12 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Deleting offline snapshot 6e458977-fb8a-4f2a-a0cd-b567beb943bc of volume 95f784e7-3ff4-449f-816d-0d336c5c641e {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 04:45:12 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] snapshot_file for this snap is: volume-95f784e7-3ff4-449f-816d-0d336c5c641e.6e458977-fb8a-4f2a-a0cd-b567beb943bc {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 04:45:12 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[f700b1e9-c1be-4fdd-a38b-43f71038cee3]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e.6e458977-fb8a-4f2a-a0cd-b567beb943bc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:12 devstack sudo[88374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e.6e458977-fb8a-4f2a-a0cd-b567beb943bc
Feb 28 04:45:12 devstack sudo[88374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:12 devstack sudo[88374]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e.6e458977-fb8a-4f2a-a0cd-b567beb943bc" returned: 0 in 0.476s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:12 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95f784e7-3ff4-449f-816d-0d336c5c641e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:45:12 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d075390-062f-4614-8295-81f316be8865]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:12 devstack sudo[88379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e
Feb 28 04:45:12 devstack sudo[88379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:13 devstack sudo[88379]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e" returned: 0 in 0.457s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e.6e458977-fb8a-4f2a-a0cd-b567beb943bc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:13 devstack sudo[88384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e.6e458977-fb8a-4f2a-a0cd-b567beb943bc
Feb 28 04:45:13 devstack sudo[88384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:13 devstack sudo[88384]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e.6e458977-fb8a-4f2a-a0cd-b567beb943bc" returned: 0 in 0.432s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e.6e458977-fb8a-4f2a-a0cd-b567beb943bc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:13 devstack sudo[88389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e.6e458977-fb8a-4f2a-a0cd-b567beb943bc
Feb 28 04:45:13 devstack sudo[88389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:14 devstack sudo[88389]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e.6e458977-fb8a-4f2a-a0cd-b567beb943bc" returned: 0 in 0.382s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:14 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Lock "cinder-quobyte-6e458977-fb8a-4f2a-a0cd-b567beb943bc" released by "_delete_snapshot" :: held 1.820s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.438s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ac6754d6-762f-46e4-af38-3e5df67c895d tempest-ServersNegativeTestJSON-2118949871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.251s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:14 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-ac6754d6-762f-46e4-af38-3e5df67c895d tempest-ServersNegativeTestJSON-2118949871 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1101703265',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1785cafa-1e40-416c-991d-e65364487353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bd6dd70b2643a6a531c361c9879e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:45:05Z,use_quota=True,user_id='cac10434d704410196cb5808ee6f4963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:45:14 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-ac6754d6-762f-46e4-af38-3e5df67c895d tempest-ServersNegativeTestJSON-2118949871 None] Creating volume 1785cafa-1e40-416c-991d-e65364487353 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:45:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ac6754d6-762f-46e4-af38-3e5df67c895d tempest-ServersNegativeTestJSON-2118949871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ac6754d6-762f-46e4-af38-3e5df67c895d tempest-ServersNegativeTestJSON-2118949871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:14 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-ac6754d6-762f-46e4-af38-3e5df67c895d tempest-ServersNegativeTestJSON-2118949871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:45:14 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-ac6754d6-762f-46e4-af38-3e5df67c895d tempest-ServersNegativeTestJSON-2118949871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:45:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ac6754d6-762f-46e4-af38-3e5df67c895d tempest-ServersNegativeTestJSON-2118949871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:14 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-ac6754d6-762f-46e4-af38-3e5df67c895d tempest-ServersNegativeTestJSON-2118949871 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:45:14 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-ac6754d6-762f-46e4-af38-3e5df67c895d tempest-ServersNegativeTestJSON-2118949871 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:45:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ac6754d6-762f-46e4-af38-3e5df67c895d tempest-ServersNegativeTestJSON-2118949871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1785cafa-1e40-416c-991d-e65364487353 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:14 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9948204-853d-41ce-9b4f-97c3e2d87d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3e925af-4443-43b5-8c0d-50047ac7592a', 'volume_size': 2, 'source_volid': '95f784e7-3ff4-449f-816d-0d336c5c641e', 'source_volstatus': 'available'}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:14 devstack sudo[88392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1785cafa-1e40-416c-991d-e65364487353 1073741824
Feb 28 04:45:14 devstack sudo[88392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:14 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4173b546-21ae-4a2d-8a9b-b81bfd3541c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:14 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Volume volume-e3e925af-4443-43b5-8c0d-50047ac7592a (e3e925af-4443-43b5-8c0d-50047ac7592a): created successfully
Feb 28 04:45:14 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4173b546-21ae-4a2d-8a9b-b81bfd3541c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:14 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Flow 'volume_create_manager' (a8bb657f-50b6-42c0-898c-69e884512ab6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:45:14 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-e932fd52-0cd6-4ebb-9b28-f3c9b7df98dd tempest-VolumesCloneTest-1972083399 None] Created volume successfully.
Feb 28 04:45:14 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-194569ea-8d59-4032-8524-018cc4846366 tempest-VolumesCloneTest-1972083399 None] Acquiring lock "cinder-e3e925af-4443-43b5-8c0d-50047ac7592a-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:14 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-194569ea-8d59-4032-8524-018cc4846366 tempest-VolumesCloneTest-1972083399 None] Lock "cinder-e3e925af-4443-43b5-8c0d-50047ac7592a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:14 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-194569ea-8d59-4032-8524-018cc4846366 tempest-VolumesCloneTest-1972083399 None] Acquiring lock "cinder-quobyte-e3e925af-4443-43b5-8c0d-50047ac7592a" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:14 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-194569ea-8d59-4032-8524-018cc4846366 tempest-VolumesCloneTest-1972083399 None] Lock "cinder-quobyte-e3e925af-4443-43b5-8c0d-50047ac7592a" acquired by "delete_volume" :: waited 0.013s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:14 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[80818192-d875-4813-904e-9df629246eab]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-194569ea-8d59-4032-8524-018cc4846366 tempest-VolumesCloneTest-1972083399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e3e925af-4443-43b5-8c0d-50047ac7592a {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:14 devstack sudo[88397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e3e925af-4443-43b5-8c0d-50047ac7592a
Feb 28 04:45:14 devstack sudo[88397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:14 devstack sudo[88392]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ac6754d6-762f-46e4-af38-3e5df67c895d tempest-ServersNegativeTestJSON-2118949871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1785cafa-1e40-416c-991d-e65364487353 1073741824" returned: 0 in 0.536s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ac6754d6-762f-46e4-af38-3e5df67c895d tempest-ServersNegativeTestJSON-2118949871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1785cafa-1e40-416c-991d-e65364487353 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:14 devstack sudo[88399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1785cafa-1e40-416c-991d-e65364487353
Feb 28 04:45:14 devstack sudo[88399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:15 devstack sudo[88397]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-194569ea-8d59-4032-8524-018cc4846366 tempest-VolumesCloneTest-1972083399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e3e925af-4443-43b5-8c0d-50047ac7592a" returned: 0 in 0.486s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-194569ea-8d59-4032-8524-018cc4846366 tempest-VolumesCloneTest-1972083399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e3e925af-4443-43b5-8c0d-50047ac7592a {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:15 devstack sudo[88405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e3e925af-4443-43b5-8c0d-50047ac7592a
Feb 28 04:45:15 devstack sudo[88405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:15 devstack sudo[88399]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ac6754d6-762f-46e4-af38-3e5df67c895d tempest-ServersNegativeTestJSON-2118949871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1785cafa-1e40-416c-991d-e65364487353" returned: 0 in 0.389s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:15 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-ac6754d6-762f-46e4-af38-3e5df67c895d tempest-ServersNegativeTestJSON-2118949871 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:45:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ac6754d6-762f-46e4-af38-3e5df67c895d tempest-ServersNegativeTestJSON-2118949871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-44155747-7bc9-4722-85fe-0cdbeed0246e tempest-VolumesActionsTest-4540298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.753s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:15 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-44155747-7bc9-4722-85fe-0cdbeed0246e tempest-VolumesActionsTest-4540298 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1678715545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ab3fd41-83b6-472a-985a-a1eb467ce559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af27b7a098294a58b84dd04067ce0e24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:45:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:45:07Z,use_quota=True,user_id='4e66d3f79b074645a4e80b9f7a373a42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:45:15 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-44155747-7bc9-4722-85fe-0cdbeed0246e tempest-VolumesActionsTest-4540298 None] Creating volume 5ab3fd41-83b6-472a-985a-a1eb467ce559 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:45:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-44155747-7bc9-4722-85fe-0cdbeed0246e tempest-VolumesActionsTest-4540298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-44155747-7bc9-4722-85fe-0cdbeed0246e tempest-VolumesActionsTest-4540298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:15 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-44155747-7bc9-4722-85fe-0cdbeed0246e tempest-VolumesActionsTest-4540298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:45:15 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-44155747-7bc9-4722-85fe-0cdbeed0246e tempest-VolumesActionsTest-4540298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:45:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-44155747-7bc9-4722-85fe-0cdbeed0246e tempest-VolumesActionsTest-4540298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:15 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-44155747-7bc9-4722-85fe-0cdbeed0246e tempest-VolumesActionsTest-4540298 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:45:15 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-44155747-7bc9-4722-85fe-0cdbeed0246e tempest-VolumesActionsTest-4540298 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:45:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-44155747-7bc9-4722-85fe-0cdbeed0246e tempest-VolumesActionsTest-4540298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-5ab3fd41-83b6-472a-985a-a1eb467ce559 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:15 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ac6754d6-762f-46e4-af38-3e5df67c895d tempest-ServersNegativeTestJSON-2118949871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4567a685-959d-41dc-927d-8d156c054c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1785cafa-1e40-416c-991d-e65364487353', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:15 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ac6754d6-762f-46e4-af38-3e5df67c895d tempest-ServersNegativeTestJSON-2118949871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f269c5da-9d52-4b7c-bd34-5937c3554102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:15 devstack sudo[88407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-5ab3fd41-83b6-472a-985a-a1eb467ce559 1073741824
Feb 28 04:45:15 devstack sudo[88407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:15 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-ac6754d6-762f-46e4-af38-3e5df67c895d tempest-ServersNegativeTestJSON-2118949871 None] Volume volume-1785cafa-1e40-416c-991d-e65364487353 (1785cafa-1e40-416c-991d-e65364487353): created successfully
Feb 28 04:45:15 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ac6754d6-762f-46e4-af38-3e5df67c895d tempest-ServersNegativeTestJSON-2118949871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f269c5da-9d52-4b7c-bd34-5937c3554102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:15 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ac6754d6-762f-46e4-af38-3e5df67c895d tempest-ServersNegativeTestJSON-2118949871 None] Flow 'volume_create_manager' (e2b16ac2-0520-443f-b572-60bfe537dde2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:45:15 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-ac6754d6-762f-46e4-af38-3e5df67c895d tempest-ServersNegativeTestJSON-2118949871 None] Created volume successfully.
Feb 28 04:45:15 devstack sudo[88405]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-194569ea-8d59-4032-8524-018cc4846366 tempest-VolumesCloneTest-1972083399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e3e925af-4443-43b5-8c0d-50047ac7592a" returned: 0 in 0.412s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:15 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-194569ea-8d59-4032-8524-018cc4846366 tempest-VolumesCloneTest-1972083399 None] Lock "cinder-quobyte-e3e925af-4443-43b5-8c0d-50047ac7592a" released by "delete_volume" :: held 0.932s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:15 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-194569ea-8d59-4032-8524-018cc4846366 tempest-VolumesCloneTest-1972083399 None] Created reservations ['2fdd7de9-b5ab-4318-8f6b-67dbb5592d17', 'ade33478-6b88-4d19-81fc-f6e7bbbc3fcd', 'bd1abb10-0dd3-4b87-bec0-501b638c8bc2', 'd8eb31ac-cc3a-47f0-83ec-54c88a3711b4'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:45:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-194569ea-8d59-4032-8524-018cc4846366 tempest-VolumesCloneTest-1972083399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-194569ea-8d59-4032-8524-018cc4846366 tempest-VolumesCloneTest-1972083399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:15 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-194569ea-8d59-4032-8524-018cc4846366 tempest-VolumesCloneTest-1972083399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:45:15 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-194569ea-8d59-4032-8524-018cc4846366 tempest-VolumesCloneTest-1972083399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:45:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-194569ea-8d59-4032-8524-018cc4846366 tempest-VolumesCloneTest-1972083399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-194569ea-8d59-4032-8524-018cc4846366 tempest-VolumesCloneTest-1972083399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:15 devstack sudo[88413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:45:15 devstack sudo[88413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:15 devstack sudo[88407]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-44155747-7bc9-4722-85fe-0cdbeed0246e tempest-VolumesActionsTest-4540298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-5ab3fd41-83b6-472a-985a-a1eb467ce559 1073741824" returned: 0 in 0.560s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:15 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-cbf60325-acaf-436d-9625-b95519d297c0 tempest-VolumesCloneTest-1972083399 None] Acquiring lock "cinder-95f784e7-3ff4-449f-816d-0d336c5c641e-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:15 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-cbf60325-acaf-436d-9625-b95519d297c0 tempest-VolumesCloneTest-1972083399 None] Lock "cinder-95f784e7-3ff4-449f-816d-0d336c5c641e-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-44155747-7bc9-4722-85fe-0cdbeed0246e tempest-VolumesActionsTest-4540298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-5ab3fd41-83b6-472a-985a-a1eb467ce559 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:15 devstack sudo[88415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-5ab3fd41-83b6-472a-985a-a1eb467ce559
Feb 28 04:45:15 devstack sudo[88415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:15 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-cbf60325-acaf-436d-9625-b95519d297c0 tempest-VolumesCloneTest-1972083399 None] Acquiring lock "cinder-quobyte-95f784e7-3ff4-449f-816d-0d336c5c641e" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:15 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-cbf60325-acaf-436d-9625-b95519d297c0 tempest-VolumesCloneTest-1972083399 None] Lock "cinder-quobyte-95f784e7-3ff4-449f-816d-0d336c5c641e" acquired by "delete_volume" :: waited 0.010s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:15 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e9cade-7a7a-42f3-a9d8-4a066edeec52]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-cbf60325-acaf-436d-9625-b95519d297c0 tempest-VolumesCloneTest-1972083399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:15 devstack sudo[88417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e
Feb 28 04:45:15 devstack sudo[88417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:16 devstack sudo[88413]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-194569ea-8d59-4032-8524-018cc4846366 tempest-VolumesCloneTest-1972083399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.529s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-194569ea-8d59-4032-8524-018cc4846366 tempest-VolumesCloneTest-1972083399 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:45:16 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-194569ea-8d59-4032-8524-018cc4846366 tempest-VolumesCloneTest-1972083399 None] Deleted volume successfully.
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-194569ea-8d59-4032-8524-018cc4846366 tempest-VolumesCloneTest-1972083399 None] Lock "cinder-e3e925af-4443-43b5-8c0d-50047ac7592a-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:16 devstack sudo[88415]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-44155747-7bc9-4722-85fe-0cdbeed0246e tempest-VolumesActionsTest-4540298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-5ab3fd41-83b6-472a-985a-a1eb467ce559" returned: 0 in 0.439s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-44155747-7bc9-4722-85fe-0cdbeed0246e tempest-VolumesActionsTest-4540298 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-44155747-7bc9-4722-85fe-0cdbeed0246e tempest-VolumesActionsTest-4540298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-f316161f-35c3-425a-8ade-62baef02d893 tempest-VolumesDeleteCascade-906689606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.718s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-f316161f-35c3-425a-8ade-62baef02d893 tempest-VolumesDeleteCascade-906689606 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1748825654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6456e9be-064e-4b81-8778-ce4c4a7fe56f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f56b2178a364e9eaa85d0a224a2ce79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:45:09Z,use_quota=True,user_id='ea39a12c50304676a7627a0ff3e77341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-f316161f-35c3-425a-8ade-62baef02d893 tempest-VolumesDeleteCascade-906689606 None] Creating volume 6456e9be-064e-4b81-8778-ce4c4a7fe56f {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-f316161f-35c3-425a-8ade-62baef02d893 tempest-VolumesDeleteCascade-906689606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-f316161f-35c3-425a-8ade-62baef02d893 tempest-VolumesDeleteCascade-906689606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-f316161f-35c3-425a-8ade-62baef02d893 tempest-VolumesDeleteCascade-906689606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-f316161f-35c3-425a-8ade-62baef02d893 tempest-VolumesDeleteCascade-906689606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-f316161f-35c3-425a-8ade-62baef02d893 tempest-VolumesDeleteCascade-906689606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-f316161f-35c3-425a-8ade-62baef02d893 tempest-VolumesDeleteCascade-906689606 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:45:16 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-f316161f-35c3-425a-8ade-62baef02d893 tempest-VolumesDeleteCascade-906689606 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f316161f-35c3-425a-8ade-62baef02d893 tempest-VolumesDeleteCascade-906689606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-44155747-7bc9-4722-85fe-0cdbeed0246e tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d444664e-2548-4f3f-bbc5-fa55527381f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ab3fd41-83b6-472a-985a-a1eb467ce559', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-44155747-7bc9-4722-85fe-0cdbeed0246e tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (881c0be4-eac7-41ea-b68f-59bf55f51ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:16 devstack sudo[88421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f 1073741824
Feb 28 04:45:16 devstack sudo[88421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:16 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-44155747-7bc9-4722-85fe-0cdbeed0246e tempest-VolumesActionsTest-4540298 None] Volume volume-5ab3fd41-83b6-472a-985a-a1eb467ce559 (5ab3fd41-83b6-472a-985a-a1eb467ce559): created successfully
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-44155747-7bc9-4722-85fe-0cdbeed0246e tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (881c0be4-eac7-41ea-b68f-59bf55f51ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-44155747-7bc9-4722-85fe-0cdbeed0246e tempest-VolumesActionsTest-4540298 None] Flow 'volume_create_manager' (fcd0d6f2-f086-4dc4-91e4-b9f4cf1dbae8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:45:16 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-44155747-7bc9-4722-85fe-0cdbeed0246e tempest-VolumesActionsTest-4540298 None] Created volume successfully.
Feb 28 04:45:16 devstack sudo[88417]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-cbf60325-acaf-436d-9625-b95519d297c0 tempest-VolumesCloneTest-1972083399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e" returned: 0 in 0.568s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-cbf60325-acaf-436d-9625-b95519d297c0 tempest-VolumesCloneTest-1972083399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:16 devstack sudo[88426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e
Feb 28 04:45:16 devstack sudo[88426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-83eca347-1089-4a60-89f1-dcd1312e62e2 tempest-ServersNegativeTestJSON-2118949871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-83eca347-1089-4a60-89f1-dcd1312e62e2 tempest-ServersNegativeTestJSON-2118949871 None] Flow 'volume_create_manager' (1a89292f-4193-490b-9a74-113b9b0c4ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-83eca347-1089-4a60-89f1-dcd1312e62e2 tempest-ServersNegativeTestJSON-2118949871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aa4b374-b4de-425e-b83a-77f389f11185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-83eca347-1089-4a60-89f1-dcd1312e62e2 tempest-ServersNegativeTestJSON-2118949871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aa4b374-b4de-425e-b83a-77f389f11185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:45:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-501681942',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35799bd8-a387-4e7f-9406-68aeb1c4726d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bd6dd70b2643a6a531c361c9879e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:45:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:45:16Z,use_quota=True,user_id='cac10434d704410196cb5808ee6f4963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-83eca347-1089-4a60-89f1-dcd1312e62e2 tempest-ServersNegativeTestJSON-2118949871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60d5ff29-f018-4773-8ffc-d22f3c50b2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-83eca347-1089-4a60-89f1-dcd1312e62e2 tempest-ServersNegativeTestJSON-2118949871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60d5ff29-f018-4773-8ffc-d22f3c50b2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-83eca347-1089-4a60-89f1-dcd1312e62e2 tempest-ServersNegativeTestJSON-2118949871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bc3f772-8027-4a4a-b590-42731872f6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-83eca347-1089-4a60-89f1-dcd1312e62e2 tempest-ServersNegativeTestJSON-2118949871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bc3f772-8027-4a4a-b590-42731872f6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35799bd8-a387-4e7f-9406-68aeb1c4726d', 'volume_name': 'volume-35799bd8-a387-4e7f-9406-68aeb1c4726d', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-83eca347-1089-4a60-89f1-dcd1312e62e2 tempest-ServersNegativeTestJSON-2118949871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a812851-2087-4812-955f-72420a322e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-83eca347-1089-4a60-89f1-dcd1312e62e2 tempest-ServersNegativeTestJSON-2118949871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a812851-2087-4812-955f-72420a322e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-83eca347-1089-4a60-89f1-dcd1312e62e2 tempest-ServersNegativeTestJSON-2118949871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf0f4fa3-8499-4cce-bb94-e7a01c2bfe6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:16 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-83eca347-1089-4a60-89f1-dcd1312e62e2 tempest-ServersNegativeTestJSON-2118949871 None] Volume 35799bd8-a387-4e7f-9406-68aeb1c4726d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35799bd8-a387-4e7f-9406-68aeb1c4726d', 'volume_size': 1}
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-83eca347-1089-4a60-89f1-dcd1312e62e2 tempest-ServersNegativeTestJSON-2118949871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:16 devstack sudo[88421]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f316161f-35c3-425a-8ade-62baef02d893 tempest-VolumesDeleteCascade-906689606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f 1073741824" returned: 0 in 0.558s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f316161f-35c3-425a-8ade-62baef02d893 tempest-VolumesDeleteCascade-906689606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:16 devstack sudo[88432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f
Feb 28 04:45:16 devstack sudo[88432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:16 devstack sudo[88426]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-cbf60325-acaf-436d-9625-b95519d297c0 tempest-VolumesCloneTest-1972083399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-95f784e7-3ff4-449f-816d-0d336c5c641e" returned: 0 in 0.448s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-cbf60325-acaf-436d-9625-b95519d297c0 tempest-VolumesCloneTest-1972083399 None] Lock "cinder-quobyte-95f784e7-3ff4-449f-816d-0d336c5c641e" released by "delete_volume" :: held 1.071s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-cbf60325-acaf-436d-9625-b95519d297c0 tempest-VolumesCloneTest-1972083399 None] Created reservations ['4a22ae18-849a-4494-82cc-92fa0cff66d4', 'e9b6e116-2f2e-4b46-a754-4857542c9c96', '8cf0e3de-3358-47b8-a646-f9c43db5a30f', '66bed998-27b8-4db5-a351-d1631ae97e9d'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-cbf60325-acaf-436d-9625-b95519d297c0 tempest-VolumesCloneTest-1972083399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-cbf60325-acaf-436d-9625-b95519d297c0 tempest-VolumesCloneTest-1972083399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-cbf60325-acaf-436d-9625-b95519d297c0 tempest-VolumesCloneTest-1972083399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-cbf60325-acaf-436d-9625-b95519d297c0 tempest-VolumesCloneTest-1972083399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-cbf60325-acaf-436d-9625-b95519d297c0 tempest-VolumesCloneTest-1972083399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-cbf60325-acaf-436d-9625-b95519d297c0 tempest-VolumesCloneTest-1972083399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:16 devstack sudo[88446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:45:16 devstack sudo[88446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-397350c1-e01f-4994-9482-c6bbc347f8f1 tempest-VolumesActionsTest-275771739 None] Acquiring lock "cinder-5ab3fd41-83b6-472a-985a-a1eb467ce559-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-397350c1-e01f-4994-9482-c6bbc347f8f1 tempest-VolumesActionsTest-275771739 None] Lock "cinder-5ab3fd41-83b6-472a-985a-a1eb467ce559-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:16 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-397350c1-e01f-4994-9482-c6bbc347f8f1 tempest-VolumesActionsTest-275771739 None] Acquiring lock "cinder-quobyte-5ab3fd41-83b6-472a-985a-a1eb467ce559" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:17 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-397350c1-e01f-4994-9482-c6bbc347f8f1 tempest-VolumesActionsTest-275771739 None] Lock "cinder-quobyte-5ab3fd41-83b6-472a-985a-a1eb467ce559" acquired by "delete_volume" :: waited 0.019s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:17 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4572c57-4b0e-4189-a6b5-eba0c964e360]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-397350c1-e01f-4994-9482-c6bbc347f8f1 tempest-VolumesActionsTest-275771739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-5ab3fd41-83b6-472a-985a-a1eb467ce559 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:17 devstack sudo[88468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-5ab3fd41-83b6-472a-985a-a1eb467ce559
Feb 28 04:45:17 devstack sudo[88468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:17 devstack sudo[88432]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f316161f-35c3-425a-8ade-62baef02d893 tempest-VolumesDeleteCascade-906689606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f" returned: 0 in 0.440s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:17 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-f316161f-35c3-425a-8ade-62baef02d893 tempest-VolumesDeleteCascade-906689606 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:45:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-f316161f-35c3-425a-8ade-62baef02d893 tempest-VolumesDeleteCascade-906689606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-83eca347-1089-4a60-89f1-dcd1312e62e2 tempest-ServersNegativeTestJSON-2118949871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.719s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:17 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-83eca347-1089-4a60-89f1-dcd1312e62e2 tempest-ServersNegativeTestJSON-2118949871 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:45:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-501681942',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35799bd8-a387-4e7f-9406-68aeb1c4726d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bd6dd70b2643a6a531c361c9879e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:45:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:45:16Z,use_quota=True,user_id='cac10434d704410196cb5808ee6f4963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:45:17 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-83eca347-1089-4a60-89f1-dcd1312e62e2 tempest-ServersNegativeTestJSON-2118949871 None] Creating volume 35799bd8-a387-4e7f-9406-68aeb1c4726d {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:45:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-83eca347-1089-4a60-89f1-dcd1312e62e2 tempest-ServersNegativeTestJSON-2118949871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-83eca347-1089-4a60-89f1-dcd1312e62e2 tempest-ServersNegativeTestJSON-2118949871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:17 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-83eca347-1089-4a60-89f1-dcd1312e62e2 tempest-ServersNegativeTestJSON-2118949871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:45:17 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-83eca347-1089-4a60-89f1-dcd1312e62e2 tempest-ServersNegativeTestJSON-2118949871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:45:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-83eca347-1089-4a60-89f1-dcd1312e62e2 tempest-ServersNegativeTestJSON-2118949871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:17 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-83eca347-1089-4a60-89f1-dcd1312e62e2 tempest-ServersNegativeTestJSON-2118949871 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:45:17 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-83eca347-1089-4a60-89f1-dcd1312e62e2 tempest-ServersNegativeTestJSON-2118949871 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:45:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-83eca347-1089-4a60-89f1-dcd1312e62e2 tempest-ServersNegativeTestJSON-2118949871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-35799bd8-a387-4e7f-9406-68aeb1c4726d 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:17 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-f316161f-35c3-425a-8ade-62baef02d893 tempest-VolumesDeleteCascade-906689606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75c76eb4-f153-404e-b9c0-91a54a1bdde0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:17 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-f316161f-35c3-425a-8ade-62baef02d893 tempest-VolumesDeleteCascade-906689606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (448c7bd8-8d19-4f1c-b142-79259396a3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:17 devstack sudo[88473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-35799bd8-a387-4e7f-9406-68aeb1c4726d 1073741824
Feb 28 04:45:17 devstack sudo[88473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:17 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-f316161f-35c3-425a-8ade-62baef02d893 tempest-VolumesDeleteCascade-906689606 None] Volume volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f (6456e9be-064e-4b81-8778-ce4c4a7fe56f): created successfully
Feb 28 04:45:17 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-f316161f-35c3-425a-8ade-62baef02d893 tempest-VolumesDeleteCascade-906689606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (448c7bd8-8d19-4f1c-b142-79259396a3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:17 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-f316161f-35c3-425a-8ade-62baef02d893 tempest-VolumesDeleteCascade-906689606 None] Flow 'volume_create_manager' (da5c3521-77c8-4c50-a188-6fd99927390d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:45:17 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-f316161f-35c3-425a-8ade-62baef02d893 tempest-VolumesDeleteCascade-906689606 None] Created volume successfully.
Feb 28 04:45:17 devstack sudo[88446]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-cbf60325-acaf-436d-9625-b95519d297c0 tempest-VolumesCloneTest-1972083399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.505s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:17 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-cbf60325-acaf-436d-9625-b95519d297c0 tempest-VolumesCloneTest-1972083399 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:45:17 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-cbf60325-acaf-436d-9625-b95519d297c0 tempest-VolumesCloneTest-1972083399 None] Deleted volume successfully.
Feb 28 04:45:17 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-cbf60325-acaf-436d-9625-b95519d297c0 tempest-VolumesCloneTest-1972083399 None] Lock "cinder-95f784e7-3ff4-449f-816d-0d336c5c641e-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:17 devstack sudo[88468]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-397350c1-e01f-4994-9482-c6bbc347f8f1 tempest-VolumesActionsTest-275771739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-5ab3fd41-83b6-472a-985a-a1eb467ce559" returned: 0 in 0.527s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-397350c1-e01f-4994-9482-c6bbc347f8f1 tempest-VolumesActionsTest-275771739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-5ab3fd41-83b6-472a-985a-a1eb467ce559 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:17 devstack sudo[88482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-5ab3fd41-83b6-472a-985a-a1eb467ce559
Feb 28 04:45:17 devstack sudo[88482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:17 devstack sudo[88473]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-83eca347-1089-4a60-89f1-dcd1312e62e2 tempest-ServersNegativeTestJSON-2118949871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-35799bd8-a387-4e7f-9406-68aeb1c4726d 1073741824" returned: 0 in 0.537s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-83eca347-1089-4a60-89f1-dcd1312e62e2 tempest-ServersNegativeTestJSON-2118949871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-35799bd8-a387-4e7f-9406-68aeb1c4726d {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:17 devstack sudo[88484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-35799bd8-a387-4e7f-9406-68aeb1c4726d
Feb 28 04:45:17 devstack sudo[88484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-7d53bcd1-1ac0-4eb1-aa29-c119faec865e tempest-VolumesDeleteCascade-906689606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:18 devstack sudo[88482]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-397350c1-e01f-4994-9482-c6bbc347f8f1 tempest-VolumesActionsTest-275771739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-5ab3fd41-83b6-472a-985a-a1eb467ce559" returned: 0 in 0.586s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:18 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-397350c1-e01f-4994-9482-c6bbc347f8f1 tempest-VolumesActionsTest-275771739 None] Lock "cinder-quobyte-5ab3fd41-83b6-472a-985a-a1eb467ce559" released by "delete_volume" :: held 1.148s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:18 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-397350c1-e01f-4994-9482-c6bbc347f8f1 tempest-VolumesActionsTest-275771739 None] Created reservations ['7b932cf2-5ca2-41bb-bdef-ae77988213c3', '51f0853c-4305-4e75-9078-822b16fd929f', 'a75b0eaf-4b38-43cb-9bcc-7178635026e3', 'da4dac20-157f-446c-aff7-10ce02879c31'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:45:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-397350c1-e01f-4994-9482-c6bbc347f8f1 tempest-VolumesActionsTest-275771739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-397350c1-e01f-4994-9482-c6bbc347f8f1 tempest-VolumesActionsTest-275771739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:18 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-397350c1-e01f-4994-9482-c6bbc347f8f1 tempest-VolumesActionsTest-275771739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:45:18 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-397350c1-e01f-4994-9482-c6bbc347f8f1 tempest-VolumesActionsTest-275771739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:45:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-397350c1-e01f-4994-9482-c6bbc347f8f1 tempest-VolumesActionsTest-275771739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-397350c1-e01f-4994-9482-c6bbc347f8f1 tempest-VolumesActionsTest-275771739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:18 devstack sudo[88484]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-83eca347-1089-4a60-89f1-dcd1312e62e2 tempest-ServersNegativeTestJSON-2118949871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-35799bd8-a387-4e7f-9406-68aeb1c4726d" returned: 0 in 0.491s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:18 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-83eca347-1089-4a60-89f1-dcd1312e62e2 tempest-ServersNegativeTestJSON-2118949871 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:45:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-83eca347-1089-4a60-89f1-dcd1312e62e2 tempest-ServersNegativeTestJSON-2118949871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-7d53bcd1-1ac0-4eb1-aa29-c119faec865e tempest-VolumesDeleteCascade-906689606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.277s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:18 devstack sudo[88488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:45:18 devstack sudo[88488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:18 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-83eca347-1089-4a60-89f1-dcd1312e62e2 tempest-ServersNegativeTestJSON-2118949871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf0f4fa3-8499-4cce-bb94-e7a01c2bfe6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35799bd8-a387-4e7f-9406-68aeb1c4726d', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:18 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-83eca347-1089-4a60-89f1-dcd1312e62e2 tempest-ServersNegativeTestJSON-2118949871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65c2a63b-2fc0-4225-9ce1-512b16351532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:18 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-7d53bcd1-1ac0-4eb1-aa29-c119faec865e tempest-VolumesDeleteCascade-906689606 None] Creating offline snapshot afb558ec-7c14-4d12-b8b5-f4a9f926a700 of volume 6456e9be-064e-4b81-8778-ce4c4a7fe56f {{(pid=84248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 04:45:18 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-83eca347-1089-4a60-89f1-dcd1312e62e2 tempest-ServersNegativeTestJSON-2118949871 None] Volume volume-35799bd8-a387-4e7f-9406-68aeb1c4726d (35799bd8-a387-4e7f-9406-68aeb1c4726d): created successfully
Feb 28 04:45:18 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-83eca347-1089-4a60-89f1-dcd1312e62e2 tempest-ServersNegativeTestJSON-2118949871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65c2a63b-2fc0-4225-9ce1-512b16351532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:18 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-83eca347-1089-4a60-89f1-dcd1312e62e2 tempest-ServersNegativeTestJSON-2118949871 None] Flow 'volume_create_manager' (1a89292f-4193-490b-9a74-113b9b0c4ff1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:45:18 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[4faf6ab8-c18f-48e7-a605-fccbd87144f6]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7d53bcd1-1ac0-4eb1-aa29-c119faec865e tempest-VolumesDeleteCascade-906689606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:18 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-83eca347-1089-4a60-89f1-dcd1312e62e2 tempest-ServersNegativeTestJSON-2118949871 None] Created volume successfully.
Feb 28 04:45:18 devstack sudo[88490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f
Feb 28 04:45:18 devstack sudo[88490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:18 devstack sudo[88488]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-397350c1-e01f-4994-9482-c6bbc347f8f1 tempest-VolumesActionsTest-275771739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.601s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:18 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-397350c1-e01f-4994-9482-c6bbc347f8f1 tempest-VolumesActionsTest-275771739 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:45:18 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-397350c1-e01f-4994-9482-c6bbc347f8f1 tempest-VolumesActionsTest-275771739 None] Deleted volume successfully.
Feb 28 04:45:18 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-397350c1-e01f-4994-9482-c6bbc347f8f1 tempest-VolumesActionsTest-275771739 None] Lock "cinder-5ab3fd41-83b6-472a-985a-a1eb467ce559-delete_volume" released by "delete_volume" :: held 1.890s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:18 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8d8750a7-5218-4d94-88c8-edc1d0ca1b8a tempest-ServersNegativeTestJSON-2118949871 None] Acquiring lock "cinder-35799bd8-a387-4e7f-9406-68aeb1c4726d-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:18 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8d8750a7-5218-4d94-88c8-edc1d0ca1b8a tempest-ServersNegativeTestJSON-2118949871 None] Lock "cinder-35799bd8-a387-4e7f-9406-68aeb1c4726d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:18 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8d8750a7-5218-4d94-88c8-edc1d0ca1b8a tempest-ServersNegativeTestJSON-2118949871 None] Acquiring lock "cinder-quobyte-35799bd8-a387-4e7f-9406-68aeb1c4726d" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:18 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8d8750a7-5218-4d94-88c8-edc1d0ca1b8a tempest-ServersNegativeTestJSON-2118949871 None] Lock "cinder-quobyte-35799bd8-a387-4e7f-9406-68aeb1c4726d" acquired by "delete_volume" :: waited 0.011s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:18 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d56b38-d1ad-4a0c-9fcd-3cf49b1bb30c]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8d8750a7-5218-4d94-88c8-edc1d0ca1b8a tempest-ServersNegativeTestJSON-2118949871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-35799bd8-a387-4e7f-9406-68aeb1c4726d {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:19 devstack sudo[88495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-35799bd8-a387-4e7f-9406-68aeb1c4726d
Feb 28 04:45:19 devstack sudo[88495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:19 devstack sudo[88490]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7d53bcd1-1ac0-4eb1-aa29-c119faec865e tempest-VolumesDeleteCascade-906689606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f" returned: 0 in 0.781s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7d53bcd1-1ac0-4eb1-aa29-c119faec865e tempest-VolumesDeleteCascade-906689606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f.afb558ec-7c14-4d12-b8b5-f4a9f926a700 1G {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:19 devstack sudo[88498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f.afb558ec-7c14-4d12-b8b5-f4a9f926a700 1G
Feb 28 04:45:19 devstack sudo[88498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:19 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-deae73b4-fc95-4948-ac4b-ead132516ded tempest-VolumesActionsTest-4540298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:45:19 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-deae73b4-fc95-4948-ac4b-ead132516ded tempest-VolumesActionsTest-4540298 None] Flow 'volume_create_manager' (46286e93-60b6-4d60-92ab-836560f0f585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:45:19 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-deae73b4-fc95-4948-ac4b-ead132516ded tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6638e328-9818-4035-817a-49009a63d4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:19 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-deae73b4-fc95-4948-ac4b-ead132516ded tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6638e328-9818-4035-817a-49009a63d4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-875397741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c8c6083-4e50-4153-82d3-4040eef7eb40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af27b7a098294a58b84dd04067ce0e24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:45:19Z,use_quota=True,user_id='4e66d3f79b074645a4e80b9f7a373a42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:19 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-deae73b4-fc95-4948-ac4b-ead132516ded tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1dd99d6-2453-4fa1-b270-3cd18fb29dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:19 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-deae73b4-fc95-4948-ac4b-ead132516ded tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1dd99d6-2453-4fa1-b270-3cd18fb29dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:19 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-deae73b4-fc95-4948-ac4b-ead132516ded tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f132df10-d714-4f12-b92b-8cdc6c9543cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:19 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-deae73b4-fc95-4948-ac4b-ead132516ded tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f132df10-d714-4f12-b92b-8cdc6c9543cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c8c6083-4e50-4153-82d3-4040eef7eb40', 'volume_name': 'volume-0c8c6083-4e50-4153-82d3-4040eef7eb40', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:19 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-deae73b4-fc95-4948-ac4b-ead132516ded tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a613a25-9ccb-4200-9482-a142f94fa2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:19 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-deae73b4-fc95-4948-ac4b-ead132516ded tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a613a25-9ccb-4200-9482-a142f94fa2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:19 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-deae73b4-fc95-4948-ac4b-ead132516ded tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec6f7129-a18e-4621-94ea-a0f9cf1a9cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:19 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-deae73b4-fc95-4948-ac4b-ead132516ded tempest-VolumesActionsTest-4540298 None] Volume 0c8c6083-4e50-4153-82d3-4040eef7eb40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c8c6083-4e50-4153-82d3-4040eef7eb40', 'volume_size': 1}
Feb 28 04:45:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-deae73b4-fc95-4948-ac4b-ead132516ded tempest-VolumesActionsTest-4540298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:19 devstack sudo[88495]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8d8750a7-5218-4d94-88c8-edc1d0ca1b8a tempest-ServersNegativeTestJSON-2118949871 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-35799bd8-a387-4e7f-9406-68aeb1c4726d" returned: 0 in 0.604s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8d8750a7-5218-4d94-88c8-edc1d0ca1b8a tempest-ServersNegativeTestJSON-2118949871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-35799bd8-a387-4e7f-9406-68aeb1c4726d {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:19 devstack sudo[88512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-35799bd8-a387-4e7f-9406-68aeb1c4726d
Feb 28 04:45:19 devstack sudo[88512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:19 devstack sudo[88498]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7d53bcd1-1ac0-4eb1-aa29-c119faec865e tempest-VolumesDeleteCascade-906689606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f.afb558ec-7c14-4d12-b8b5-f4a9f926a700 1G" returned: 0 in 0.573s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7d53bcd1-1ac0-4eb1-aa29-c119faec865e tempest-VolumesDeleteCascade-906689606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f.afb558ec-7c14-4d12-b8b5-f4a9f926a700 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:19 devstack sudo[88514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f.afb558ec-7c14-4d12-b8b5-f4a9f926a700
Feb 28 04:45:19 devstack sudo[88514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:20 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cb776aa-f0ea-4669-b206-60207f1a18fa tempest-VolumesCloneNegativeTest-1926358792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:45:20 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-7cb776aa-f0ea-4669-b206-60207f1a18fa tempest-VolumesCloneNegativeTest-1926358792 None] Flow 'volume_create_manager' (2f363e36-3603-456e-b8c9-5b83aa82d264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:45:20 devstack sudo[88512]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:20 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-7cb776aa-f0ea-4669-b206-60207f1a18fa tempest-VolumesCloneNegativeTest-1926358792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6f406bb-4c73-4e76-a6ae-5da0e4b7e3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8d8750a7-5218-4d94-88c8-edc1d0ca1b8a tempest-ServersNegativeTestJSON-2118949871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-35799bd8-a387-4e7f-9406-68aeb1c4726d" returned: 0 in 0.440s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:20 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-7cb776aa-f0ea-4669-b206-60207f1a18fa tempest-VolumesCloneNegativeTest-1926358792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6f406bb-4c73-4e76-a6ae-5da0e4b7e3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:45:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-698408893',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d51eda68-2278-4f22-919b-17da508ccf5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='393942da5cf54d928222b8349fbbeb48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:45:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:45:20Z,use_quota=True,user_id='04c31aa793d042098e33abdb2d2b6dd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:20 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-7cb776aa-f0ea-4669-b206-60207f1a18fa tempest-VolumesCloneNegativeTest-1926358792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f69b81-8f06-4c1b-a74d-e9456f08c58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:20 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-7cb776aa-f0ea-4669-b206-60207f1a18fa tempest-VolumesCloneNegativeTest-1926358792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f69b81-8f06-4c1b-a74d-e9456f08c58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:20 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-7cb776aa-f0ea-4669-b206-60207f1a18fa tempest-VolumesCloneNegativeTest-1926358792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7d924f1-7187-4df5-8962-8af6b06a0881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:20 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-7cb776aa-f0ea-4669-b206-60207f1a18fa tempest-VolumesCloneNegativeTest-1926358792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7d924f1-7187-4df5-8962-8af6b06a0881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd51eda68-2278-4f22-919b-17da508ccf5a', 'volume_name': 'volume-d51eda68-2278-4f22-919b-17da508ccf5a', 'volume_size': 2}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:20 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-7cb776aa-f0ea-4669-b206-60207f1a18fa tempest-VolumesCloneNegativeTest-1926358792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6797c9ec-815e-4b88-a2c2-07d2e8a14589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:20 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-7cb776aa-f0ea-4669-b206-60207f1a18fa tempest-VolumesCloneNegativeTest-1926358792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6797c9ec-815e-4b88-a2c2-07d2e8a14589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:20 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-7cb776aa-f0ea-4669-b206-60207f1a18fa tempest-VolumesCloneNegativeTest-1926358792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17b7af22-efeb-4c9a-bda0-055b04530936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:20 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-7cb776aa-f0ea-4669-b206-60207f1a18fa tempest-VolumesCloneNegativeTest-1926358792 None] Volume d51eda68-2278-4f22-919b-17da508ccf5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d51eda68-2278-4f22-919b-17da508ccf5a', 'volume_size': 2}
Feb 28 04:45:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-7cb776aa-f0ea-4669-b206-60207f1a18fa tempest-VolumesCloneNegativeTest-1926358792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:20 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8d8750a7-5218-4d94-88c8-edc1d0ca1b8a tempest-ServersNegativeTestJSON-2118949871 None] Lock "cinder-quobyte-35799bd8-a387-4e7f-9406-68aeb1c4726d" released by "delete_volume" :: held 1.110s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:20 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-8d8750a7-5218-4d94-88c8-edc1d0ca1b8a tempest-ServersNegativeTestJSON-2118949871 None] Created reservations ['4831b965-8079-4c39-9e09-9da1454645e6', 'f7879ff6-cc35-4b21-91ac-60e71f8063e8', 'bd1f0a58-43cb-46d4-85e3-f25f0b79ec98', 'f85f71b3-b8a6-4e8f-9e03-bea35a10c3ca'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:45:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-8d8750a7-5218-4d94-88c8-edc1d0ca1b8a tempest-ServersNegativeTestJSON-2118949871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-8d8750a7-5218-4d94-88c8-edc1d0ca1b8a tempest-ServersNegativeTestJSON-2118949871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:20 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-8d8750a7-5218-4d94-88c8-edc1d0ca1b8a tempest-ServersNegativeTestJSON-2118949871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:45:20 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-8d8750a7-5218-4d94-88c8-edc1d0ca1b8a tempest-ServersNegativeTestJSON-2118949871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:45:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-8d8750a7-5218-4d94-88c8-edc1d0ca1b8a tempest-ServersNegativeTestJSON-2118949871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8d8750a7-5218-4d94-88c8-edc1d0ca1b8a tempest-ServersNegativeTestJSON-2118949871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:20 devstack sudo[88514]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:20 devstack sudo[88521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:45:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7d53bcd1-1ac0-4eb1-aa29-c119faec865e tempest-VolumesDeleteCascade-906689606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f.afb558ec-7c14-4d12-b8b5-f4a9f926a700" returned: 0 in 0.500s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:20 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-7d53bcd1-1ac0-4eb1-aa29-c119faec865e tempest-VolumesDeleteCascade-906689606 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f.afb558ec-7c14-4d12-b8b5-f4a9f926a700 is being set with open permissions: ugo+rw
Feb 28 04:45:20 devstack sudo[88521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7d53bcd1-1ac0-4eb1-aa29-c119faec865e tempest-VolumesDeleteCascade-906689606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f.afb558ec-7c14-4d12-b8b5-f4a9f926a700 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:20 devstack sudo[88523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f.afb558ec-7c14-4d12-b8b5-f4a9f926a700
Feb 28 04:45:20 devstack sudo[88523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:20 devstack sudo[88521]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8d8750a7-5218-4d94-88c8-edc1d0ca1b8a tempest-ServersNegativeTestJSON-2118949871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.423s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:20 devstack sudo[88523]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:20 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-8d8750a7-5218-4d94-88c8-edc1d0ca1b8a tempest-ServersNegativeTestJSON-2118949871 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:45:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7d53bcd1-1ac0-4eb1-aa29-c119faec865e tempest-VolumesDeleteCascade-906689606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f.afb558ec-7c14-4d12-b8b5-f4a9f926a700" returned: 0 in 0.406s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:20 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-8d8750a7-5218-4d94-88c8-edc1d0ca1b8a tempest-ServersNegativeTestJSON-2118949871 None] Deleted volume successfully.
Feb 28 04:45:20 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8d8750a7-5218-4d94-88c8-edc1d0ca1b8a tempest-ServersNegativeTestJSON-2118949871 None] Lock "cinder-35799bd8-a387-4e7f-9406-68aeb1c4726d-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7d53bcd1-1ac0-4eb1-aa29-c119faec865e tempest-VolumesDeleteCascade-906689606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:20 devstack sudo[88527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f.info
Feb 28 04:45:20 devstack sudo[88527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:21 devstack sudo[88527]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7d53bcd1-1ac0-4eb1-aa29-c119faec865e tempest-VolumesDeleteCascade-906689606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f.info" returned: 0 in 0.408s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:21 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-7d53bcd1-1ac0-4eb1-aa29-c119faec865e tempest-VolumesDeleteCascade-906689606 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f.info is being set with open permissions: ugo+rw
Feb 28 04:45:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7d53bcd1-1ac0-4eb1-aa29-c119faec865e tempest-VolumesDeleteCascade-906689606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:21 devstack sudo[88530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f.info
Feb 28 04:45:21 devstack sudo[88530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:21 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-e3fc4bdb-7c7d-4e34-9c21-36b84212e36b tempest-ServersNegativeTestJSON-2118949871 None] Acquiring lock "cinder-1785cafa-1e40-416c-991d-e65364487353-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:21 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-e3fc4bdb-7c7d-4e34-9c21-36b84212e36b tempest-ServersNegativeTestJSON-2118949871 None] Lock "cinder-1785cafa-1e40-416c-991d-e65364487353-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:21 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-e3fc4bdb-7c7d-4e34-9c21-36b84212e36b tempest-ServersNegativeTestJSON-2118949871 None] Acquiring lock "cinder-quobyte-1785cafa-1e40-416c-991d-e65364487353" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:21 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-e3fc4bdb-7c7d-4e34-9c21-36b84212e36b tempest-ServersNegativeTestJSON-2118949871 None] Lock "cinder-quobyte-1785cafa-1e40-416c-991d-e65364487353" acquired by "delete_volume" :: waited 0.008s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:21 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9fa0a9-50ac-4dcf-8fdc-61205535e1a9]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e3fc4bdb-7c7d-4e34-9c21-36b84212e36b tempest-ServersNegativeTestJSON-2118949871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1785cafa-1e40-416c-991d-e65364487353 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:21 devstack sudo[88532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1785cafa-1e40-416c-991d-e65364487353
Feb 28 04:45:21 devstack sudo[88532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:21 devstack sudo[88530]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7d53bcd1-1ac0-4eb1-aa29-c119faec865e tempest-VolumesDeleteCascade-906689606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f.info" returned: 0 in 0.428s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-7d53bcd1-1ac0-4eb1-aa29-c119faec865e tempest-VolumesDeleteCascade-906689606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.187s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-deae73b4-fc95-4948-ac4b-ead132516ded tempest-VolumesActionsTest-4540298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.922s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:21 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-deae73b4-fc95-4948-ac4b-ead132516ded tempest-VolumesActionsTest-4540298 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-875397741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c8c6083-4e50-4153-82d3-4040eef7eb40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af27b7a098294a58b84dd04067ce0e24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:45:19Z,use_quota=True,user_id='4e66d3f79b074645a4e80b9f7a373a42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:45:21 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-deae73b4-fc95-4948-ac4b-ead132516ded tempest-VolumesActionsTest-4540298 None] Creating volume 0c8c6083-4e50-4153-82d3-4040eef7eb40 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:45:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-deae73b4-fc95-4948-ac4b-ead132516ded tempest-VolumesActionsTest-4540298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-deae73b4-fc95-4948-ac4b-ead132516ded tempest-VolumesActionsTest-4540298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:21 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-deae73b4-fc95-4948-ac4b-ead132516ded tempest-VolumesActionsTest-4540298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:45:21 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-deae73b4-fc95-4948-ac4b-ead132516ded tempest-VolumesActionsTest-4540298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:45:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-deae73b4-fc95-4948-ac4b-ead132516ded tempest-VolumesActionsTest-4540298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:21 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-deae73b4-fc95-4948-ac4b-ead132516ded tempest-VolumesActionsTest-4540298 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:45:21 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-deae73b4-fc95-4948-ac4b-ead132516ded tempest-VolumesActionsTest-4540298 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:45:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-deae73b4-fc95-4948-ac4b-ead132516ded tempest-VolumesActionsTest-4540298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0c8c6083-4e50-4153-82d3-4040eef7eb40 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:21 devstack sudo[88535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0c8c6083-4e50-4153-82d3-4040eef7eb40 1073741824
Feb 28 04:45:21 devstack sudo[88535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:21 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-7d53bcd1-1ac0-4eb1-aa29-c119faec865e tempest-VolumesDeleteCascade-906689606 None] Create snapshot completed successfully
Feb 28 04:45:21 devstack sudo[88532]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e3fc4bdb-7c7d-4e34-9c21-36b84212e36b tempest-ServersNegativeTestJSON-2118949871 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1785cafa-1e40-416c-991d-e65364487353" returned: 0 in 0.484s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e3fc4bdb-7c7d-4e34-9c21-36b84212e36b tempest-ServersNegativeTestJSON-2118949871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1785cafa-1e40-416c-991d-e65364487353 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:21 devstack sudo[88540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1785cafa-1e40-416c-991d-e65364487353
Feb 28 04:45:21 devstack sudo[88540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:21 devstack sudo[88535]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-deae73b4-fc95-4948-ac4b-ead132516ded tempest-VolumesActionsTest-4540298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0c8c6083-4e50-4153-82d3-4040eef7eb40 1073741824" returned: 0 in 0.492s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-deae73b4-fc95-4948-ac4b-ead132516ded tempest-VolumesActionsTest-4540298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0c8c6083-4e50-4153-82d3-4040eef7eb40 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:21 devstack sudo[88545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0c8c6083-4e50-4153-82d3-4040eef7eb40
Feb 28 04:45:21 devstack sudo[88545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:22 devstack sudo[88540]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e3fc4bdb-7c7d-4e34-9c21-36b84212e36b tempest-ServersNegativeTestJSON-2118949871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1785cafa-1e40-416c-991d-e65364487353" returned: 0 in 0.410s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:22 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-e3fc4bdb-7c7d-4e34-9c21-36b84212e36b tempest-ServersNegativeTestJSON-2118949871 None] Lock "cinder-quobyte-1785cafa-1e40-416c-991d-e65364487353" released by "delete_volume" :: held 0.927s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:22 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-e3fc4bdb-7c7d-4e34-9c21-36b84212e36b tempest-ServersNegativeTestJSON-2118949871 None] Created reservations ['258739a3-365a-4fc4-9878-1f4dec8ab29d', '145fc6de-bbc4-4eda-89de-8e64db00de7e', 'a15b7b9e-78fb-4717-a5ee-20bbdc859585', 'e05b0d49-00f2-45b5-bb70-88cb11b64fd3'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:45:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e3fc4bdb-7c7d-4e34-9c21-36b84212e36b tempest-ServersNegativeTestJSON-2118949871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e3fc4bdb-7c7d-4e34-9c21-36b84212e36b tempest-ServersNegativeTestJSON-2118949871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:22 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-e3fc4bdb-7c7d-4e34-9c21-36b84212e36b tempest-ServersNegativeTestJSON-2118949871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:45:22 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-e3fc4bdb-7c7d-4e34-9c21-36b84212e36b tempest-ServersNegativeTestJSON-2118949871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:45:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e3fc4bdb-7c7d-4e34-9c21-36b84212e36b tempest-ServersNegativeTestJSON-2118949871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e3fc4bdb-7c7d-4e34-9c21-36b84212e36b tempest-ServersNegativeTestJSON-2118949871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:22 devstack sudo[88548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:45:22 devstack sudo[88548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:22 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:45:22 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Flow 'volume_create_manager' (6332d229-c2cb-4821-9539-239a34755f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:45:22 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (738cca06-c926-464b-866c-c552e9025cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:22 devstack sudo[88545]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:22 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (738cca06-c926-464b-866c-c552e9025cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-389452799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e375fcc-0f47-43a2-a414-9a0cfc9d6d75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f56b2178a364e9eaa85d0a224a2ce79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=afb558ec-7c14-4d12-b8b5-f4a9f926a700,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:45:22Z,use_quota=True,user_id='ea39a12c50304676a7627a0ff3e77341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:22 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc492bf3-ea98-4ad8-b3d7-97550becccca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:22 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc492bf3-ea98-4ad8-b3d7-97550becccca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:22 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3be78b4-bb86-419a-982b-0cede7a605ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:22 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3be78b4-bb86-419a-982b-0cede7a605ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6e375fcc-0f47-43a2-a414-9a0cfc9d6d75', 'volume_name': 'volume-6e375fcc-0f47-43a2-a414-9a0cfc9d6d75', 'volume_size': 1, 'snapshot_id': 'afb558ec-7c14-4d12-b8b5-f4a9f926a700'}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:22 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10aebbfe-a15e-4a26-a2d3-9516c80c76a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:22 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10aebbfe-a15e-4a26-a2d3-9516c80c76a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:22 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad1394e7-9583-4c71-bc06-4ba7e14f8978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:22 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Volume 6e375fcc-0f47-43a2-a414-9a0cfc9d6d75: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6e375fcc-0f47-43a2-a414-9a0cfc9d6d75', 'volume_size': 1, 'snapshot_id': 'afb558ec-7c14-4d12-b8b5-f4a9f926a700'}
Feb 28 04:45:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-deae73b4-fc95-4948-ac4b-ead132516ded tempest-VolumesActionsTest-4540298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0c8c6083-4e50-4153-82d3-4040eef7eb40" returned: 0 in 0.619s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:22 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-deae73b4-fc95-4948-ac4b-ead132516ded tempest-VolumesActionsTest-4540298 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:45:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-deae73b4-fc95-4948-ac4b-ead132516ded tempest-VolumesActionsTest-4540298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-7cb776aa-f0ea-4669-b206-60207f1a18fa tempest-VolumesCloneNegativeTest-1926358792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.506s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:22 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-7cb776aa-f0ea-4669-b206-60207f1a18fa tempest-VolumesCloneNegativeTest-1926358792 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:45:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-698408893',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d51eda68-2278-4f22-919b-17da508ccf5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='393942da5cf54d928222b8349fbbeb48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:45:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:45:20Z,use_quota=True,user_id='04c31aa793d042098e33abdb2d2b6dd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:45:22 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-7cb776aa-f0ea-4669-b206-60207f1a18fa tempest-VolumesCloneNegativeTest-1926358792 None] Creating volume d51eda68-2278-4f22-919b-17da508ccf5a {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:45:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-7cb776aa-f0ea-4669-b206-60207f1a18fa tempest-VolumesCloneNegativeTest-1926358792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-7cb776aa-f0ea-4669-b206-60207f1a18fa tempest-VolumesCloneNegativeTest-1926358792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:22 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-7cb776aa-f0ea-4669-b206-60207f1a18fa tempest-VolumesCloneNegativeTest-1926358792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:45:22 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-7cb776aa-f0ea-4669-b206-60207f1a18fa tempest-VolumesCloneNegativeTest-1926358792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:45:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-7cb776aa-f0ea-4669-b206-60207f1a18fa tempest-VolumesCloneNegativeTest-1926358792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:22 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-7cb776aa-f0ea-4669-b206-60207f1a18fa tempest-VolumesCloneNegativeTest-1926358792 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:45:22 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-7cb776aa-f0ea-4669-b206-60207f1a18fa tempest-VolumesCloneNegativeTest-1926358792 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:45:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7cb776aa-f0ea-4669-b206-60207f1a18fa tempest-VolumesCloneNegativeTest-1926358792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-d51eda68-2278-4f22-919b-17da508ccf5a 2147483648 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:22 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-deae73b4-fc95-4948-ac4b-ead132516ded tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec6f7129-a18e-4621-94ea-a0f9cf1a9cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c8c6083-4e50-4153-82d3-4040eef7eb40', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:22 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-deae73b4-fc95-4948-ac4b-ead132516ded tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4915a071-cdd0-4f57-85e4-939f7ef7cd10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:22 devstack sudo[88552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-d51eda68-2278-4f22-919b-17da508ccf5a 2147483648
Feb 28 04:45:22 devstack sudo[88552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:22 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-deae73b4-fc95-4948-ac4b-ead132516ded tempest-VolumesActionsTest-4540298 None] Volume volume-0c8c6083-4e50-4153-82d3-4040eef7eb40 (0c8c6083-4e50-4153-82d3-4040eef7eb40): created successfully
Feb 28 04:45:22 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-deae73b4-fc95-4948-ac4b-ead132516ded tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4915a071-cdd0-4f57-85e4-939f7ef7cd10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:22 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-deae73b4-fc95-4948-ac4b-ead132516ded tempest-VolumesActionsTest-4540298 None] Flow 'volume_create_manager' (46286e93-60b6-4d60-92ab-836560f0f585) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:45:22 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-deae73b4-fc95-4948-ac4b-ead132516ded tempest-VolumesActionsTest-4540298 None] Created volume successfully.
Feb 28 04:45:22 devstack sudo[88548]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e3fc4bdb-7c7d-4e34-9c21-36b84212e36b tempest-ServersNegativeTestJSON-2118949871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.511s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:22 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-e3fc4bdb-7c7d-4e34-9c21-36b84212e36b tempest-ServersNegativeTestJSON-2118949871 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:45:22 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-e3fc4bdb-7c7d-4e34-9c21-36b84212e36b tempest-ServersNegativeTestJSON-2118949871 None] Deleted volume successfully.
Feb 28 04:45:22 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-e3fc4bdb-7c7d-4e34-9c21-36b84212e36b tempest-ServersNegativeTestJSON-2118949871 None] Lock "cinder-1785cafa-1e40-416c-991d-e65364487353-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:23 devstack sudo[88552]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7cb776aa-f0ea-4669-b206-60207f1a18fa tempest-VolumesCloneNegativeTest-1926358792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-d51eda68-2278-4f22-919b-17da508ccf5a 2147483648" returned: 0 in 0.585s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7cb776aa-f0ea-4669-b206-60207f1a18fa tempest-VolumesCloneNegativeTest-1926358792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-d51eda68-2278-4f22-919b-17da508ccf5a {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:23 devstack sudo[88557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-d51eda68-2278-4f22-919b-17da508ccf5a
Feb 28 04:45:23 devstack sudo[88557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:23 devstack sudo[88557]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7cb776aa-f0ea-4669-b206-60207f1a18fa tempest-VolumesCloneNegativeTest-1926358792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-d51eda68-2278-4f22-919b-17da508ccf5a" returned: 0 in 0.580s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:23 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-7cb776aa-f0ea-4669-b206-60207f1a18fa tempest-VolumesCloneNegativeTest-1926358792 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:45:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-7cb776aa-f0ea-4669-b206-60207f1a18fa tempest-VolumesCloneNegativeTest-1926358792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.203s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:23 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Acquiring lock "cinder-quobyte-afb558ec-7c14-4d12-b8b5-f4a9f926a700-6e375fcc-0f47-43a2-a414-9a0cfc9d6d75" by "_create_volume_from_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:23 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-7cb776aa-f0ea-4669-b206-60207f1a18fa tempest-VolumesCloneNegativeTest-1926358792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17b7af22-efeb-4c9a-bda0-055b04530936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d51eda68-2278-4f22-919b-17da508ccf5a', 'volume_size': 2}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:23 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-7cb776aa-f0ea-4669-b206-60207f1a18fa tempest-VolumesCloneNegativeTest-1926358792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (470964de-d6dc-4b15-ae70-091b5d998712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:23 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Lock "cinder-quobyte-afb558ec-7c14-4d12-b8b5-f4a9f926a700-6e375fcc-0f47-43a2-a414-9a0cfc9d6d75" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:23 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Creating volume 6e375fcc-0f47-43a2-a414-9a0cfc9d6d75 from snapshot afb558ec-7c14-4d12-b8b5-f4a9f926a700 {{(pid=84248) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Feb 28 04:45:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:23 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:45:23 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:45:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:23 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:45:23 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Acquiring lock "cinder-quobyte-6e375fcc-0f47-43a2-a414-9a0cfc9d6d75" by "_copy_volume_from_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:23 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-7cb776aa-f0ea-4669-b206-60207f1a18fa tempest-VolumesCloneNegativeTest-1926358792 None] Volume volume-d51eda68-2278-4f22-919b-17da508ccf5a (d51eda68-2278-4f22-919b-17da508ccf5a): created successfully
Feb 28 04:45:23 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-7cb776aa-f0ea-4669-b206-60207f1a18fa tempest-VolumesCloneNegativeTest-1926358792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (470964de-d6dc-4b15-ae70-091b5d998712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:23 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-7cb776aa-f0ea-4669-b206-60207f1a18fa tempest-VolumesCloneNegativeTest-1926358792 None] Flow 'volume_create_manager' (2f363e36-3603-456e-b8c9-5b83aa82d264) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:45:23 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Lock "cinder-quobyte-6e375fcc-0f47-43a2-a414-9a0cfc9d6d75" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:23 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] snapshot: afb558ec-7c14-4d12-b8b5-f4a9f926a700, volume: 6e375fcc-0f47-43a2-a414-9a0cfc9d6d75,  {{(pid=84248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 28 04:45:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:23 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:45:23 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:45:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:23 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-7cb776aa-f0ea-4669-b206-60207f1a18fa tempest-VolumesCloneNegativeTest-1926358792 None] Created volume successfully.
Feb 28 04:45:23 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7142c4-1207-4c35-a03c-781c791ad59d]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f.afb558ec-7c14-4d12-b8b5-f4a9f926a700 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:23 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-4716f78e-2c96-44cb-a16f-0436df94da37 tempest-VolumesActionsTest-275771739 None] Acquiring lock "cinder-0c8c6083-4e50-4153-82d3-4040eef7eb40-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:23 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-4716f78e-2c96-44cb-a16f-0436df94da37 tempest-VolumesActionsTest-275771739 None] Lock "cinder-0c8c6083-4e50-4153-82d3-4040eef7eb40-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:24 devstack sudo[88583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f.afb558ec-7c14-4d12-b8b5-f4a9f926a700
Feb 28 04:45:24 devstack sudo[88583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:24 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-4716f78e-2c96-44cb-a16f-0436df94da37 tempest-VolumesActionsTest-275771739 None] Acquiring lock "cinder-quobyte-0c8c6083-4e50-4153-82d3-4040eef7eb40" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:24 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-4716f78e-2c96-44cb-a16f-0436df94da37 tempest-VolumesActionsTest-275771739 None] Lock "cinder-quobyte-0c8c6083-4e50-4153-82d3-4040eef7eb40" acquired by "delete_volume" :: waited 0.007s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:24 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59cef61-8a25-4578-84cd-2f2a694a5c73]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4716f78e-2c96-44cb-a16f-0436df94da37 tempest-VolumesActionsTest-275771739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0c8c6083-4e50-4153-82d3-4040eef7eb40 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:24 devstack sudo[88585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0c8c6083-4e50-4153-82d3-4040eef7eb40
Feb 28 04:45:24 devstack sudo[88585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:24 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-bb30b766-ed8a-424d-99e0-bdbb916558fa tempest-VolumesCloneNegativeTest-1926358792 None] Acquiring lock "cinder-d51eda68-2278-4f22-919b-17da508ccf5a-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:24 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-bb30b766-ed8a-424d-99e0-bdbb916558fa tempest-VolumesCloneNegativeTest-1926358792 None] Lock "cinder-d51eda68-2278-4f22-919b-17da508ccf5a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:24 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-bb30b766-ed8a-424d-99e0-bdbb916558fa tempest-VolumesCloneNegativeTest-1926358792 None] Acquiring lock "cinder-quobyte-d51eda68-2278-4f22-919b-17da508ccf5a" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:24 devstack cinder-volume[84248]: DEBUG oslo_service.periodic_task [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84248) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 28 04:45:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:24 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:45:24 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:45:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:24 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-bb30b766-ed8a-424d-99e0-bdbb916558fa tempest-VolumesCloneNegativeTest-1926358792 None] Lock "cinder-quobyte-d51eda68-2278-4f22-919b-17da508ccf5a" acquired by "delete_volume" :: waited 0.070s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:24 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[941db94e-8f6e-438d-b89e-4e3bfe5e2431]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-bb30b766-ed8a-424d-99e0-bdbb916558fa tempest-VolumesCloneNegativeTest-1926358792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-d51eda68-2278-4f22-919b-17da508ccf5a {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:24 devstack sudo[88589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:45:24 devstack sudo[88589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:24 devstack sudo[88592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-d51eda68-2278-4f22-919b-17da508ccf5a
Feb 28 04:45:24 devstack sudo[88592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:24 devstack sudo[88585]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4716f78e-2c96-44cb-a16f-0436df94da37 tempest-VolumesActionsTest-275771739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0c8c6083-4e50-4153-82d3-4040eef7eb40" returned: 0 in 0.858s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4716f78e-2c96-44cb-a16f-0436df94da37 tempest-VolumesActionsTest-275771739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0c8c6083-4e50-4153-82d3-4040eef7eb40 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:24 devstack sudo[88583]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f.afb558ec-7c14-4d12-b8b5-f4a9f926a700" returned: 0 in 1.043s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:24 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:45:24 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] will copy from snapshot at /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f {{(pid=84248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 28 04:45:24 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Creating direct copy from snapshot {{(pid=84248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 28 04:45:24 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e3c70b-2cd9-4923-8e47-7bfaf119b2fd]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:24 devstack sudo[88601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0c8c6083-4e50-4153-82d3-4040eef7eb40
Feb 28 04:45:24 devstack sudo[88601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:25 devstack sudo[88602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f
Feb 28 04:45:25 devstack sudo[88602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:25 devstack sudo[88589]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.820s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:25 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:45:25 devstack sudo[88601]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4716f78e-2c96-44cb-a16f-0436df94da37 tempest-VolumesActionsTest-275771739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0c8c6083-4e50-4153-82d3-4040eef7eb40" returned: 0 in 0.701s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:25 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-4716f78e-2c96-44cb-a16f-0436df94da37 tempest-VolumesActionsTest-275771739 None] Lock "cinder-quobyte-0c8c6083-4e50-4153-82d3-4040eef7eb40" released by "delete_volume" :: held 1.588s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:25 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-4716f78e-2c96-44cb-a16f-0436df94da37 tempest-VolumesActionsTest-275771739 None] Created reservations ['8cd1ff54-4e07-4a8a-9e03-138aca729f98', '733fe8ad-47bc-49bc-97a9-230b222fb68c', '0570eac0-a43e-483d-9fd4-f8371c0f0621', '1f8923d3-0923-4eb8-a42e-6033b7ac093c'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:45:25 devstack sudo[88592]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-bb30b766-ed8a-424d-99e0-bdbb916558fa tempest-VolumesCloneNegativeTest-1926358792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-d51eda68-2278-4f22-919b-17da508ccf5a" returned: 0 in 1.108s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-bb30b766-ed8a-424d-99e0-bdbb916558fa tempest-VolumesCloneNegativeTest-1926358792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-d51eda68-2278-4f22-919b-17da508ccf5a {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:25 devstack sudo[88615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-d51eda68-2278-4f22-919b-17da508ccf5a
Feb 28 04:45:25 devstack sudo[88615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-4716f78e-2c96-44cb-a16f-0436df94da37 tempest-VolumesActionsTest-275771739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-4716f78e-2c96-44cb-a16f-0436df94da37 tempest-VolumesActionsTest-275771739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:25 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-4716f78e-2c96-44cb-a16f-0436df94da37 tempest-VolumesActionsTest-275771739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:45:25 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-4716f78e-2c96-44cb-a16f-0436df94da37 tempest-VolumesActionsTest-275771739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:45:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-4716f78e-2c96-44cb-a16f-0436df94da37 tempest-VolumesActionsTest-275771739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4716f78e-2c96-44cb-a16f-0436df94da37 tempest-VolumesActionsTest-275771739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:25 devstack sudo[88602]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f" returned: 0 in 0.890s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:25 devstack cinder-volume[84248]: DEBUG cinder.utils [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Path /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6e375fcc-0f47-43a2-a414-9a0cfc9d6d75 not found in is_blk_device check {{(pid=84248) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 28 04:45:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6e375fcc-0f47-43a2-a414-9a0cfc9d6d75 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:25 devstack sudo[88618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:45:25 devstack sudo[88618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:25 devstack sudo[88619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6e375fcc-0f47-43a2-a414-9a0cfc9d6d75
Feb 28 04:45:25 devstack sudo[88619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:26 devstack sudo[88615]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-bb30b766-ed8a-424d-99e0-bdbb916558fa tempest-VolumesCloneNegativeTest-1926358792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-d51eda68-2278-4f22-919b-17da508ccf5a" returned: 0 in 0.433s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:26 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-bb30b766-ed8a-424d-99e0-bdbb916558fa tempest-VolumesCloneNegativeTest-1926358792 None] Lock "cinder-quobyte-d51eda68-2278-4f22-919b-17da508ccf5a" released by "delete_volume" :: held 1.567s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:26 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-bb30b766-ed8a-424d-99e0-bdbb916558fa tempest-VolumesCloneNegativeTest-1926358792 None] Created reservations ['e3b7426a-c500-4d37-924e-3bfe2cecd42b', 'e5bea8ff-6535-44fc-8763-47bafbe3c9d9', 'c942407e-8b93-4ccf-aef6-b5b929aa3c28', '69496e28-a126-4cb4-b0c5-8216fa751403'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:45:26 devstack sudo[88618]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4716f78e-2c96-44cb-a16f-0436df94da37 tempest-VolumesActionsTest-275771739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.424s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:26 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-4716f78e-2c96-44cb-a16f-0436df94da37 tempest-VolumesActionsTest-275771739 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:45:26 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-4716f78e-2c96-44cb-a16f-0436df94da37 tempest-VolumesActionsTest-275771739 None] Deleted volume successfully.
Feb 28 04:45:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-bb30b766-ed8a-424d-99e0-bdbb916558fa tempest-VolumesCloneNegativeTest-1926358792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-bb30b766-ed8a-424d-99e0-bdbb916558fa tempest-VolumesCloneNegativeTest-1926358792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:26 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-bb30b766-ed8a-424d-99e0-bdbb916558fa tempest-VolumesCloneNegativeTest-1926358792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:45:26 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-bb30b766-ed8a-424d-99e0-bdbb916558fa tempest-VolumesCloneNegativeTest-1926358792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:45:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-bb30b766-ed8a-424d-99e0-bdbb916558fa tempest-VolumesCloneNegativeTest-1926358792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-bb30b766-ed8a-424d-99e0-bdbb916558fa tempest-VolumesCloneNegativeTest-1926358792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:26 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-4716f78e-2c96-44cb-a16f-0436df94da37 tempest-VolumesActionsTest-275771739 None] Lock "cinder-0c8c6083-4e50-4153-82d3-4040eef7eb40-delete_volume" released by "delete_volume" :: held 2.282s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:26 devstack sudo[88627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:45:26 devstack sudo[88627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:27 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-5701c75c-0915-4dfc-8724-e2acae037bf5 tempest-VolumesActionsTest-4540298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:45:27 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5701c75c-0915-4dfc-8724-e2acae037bf5 tempest-VolumesActionsTest-4540298 None] Flow 'volume_create_manager' (28bf7d02-85b0-4ab1-a8df-eecd9ae20a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:45:27 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5701c75c-0915-4dfc-8724-e2acae037bf5 tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43ba3617-f49a-465f-839b-6c93777f7595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:27 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5701c75c-0915-4dfc-8724-e2acae037bf5 tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43ba3617-f49a-465f-839b-6c93777f7595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1187166550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9576545-0200-4cb5-957f-e14be31f2682,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af27b7a098294a58b84dd04067ce0e24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:45:27Z,use_quota=True,user_id='4e66d3f79b074645a4e80b9f7a373a42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:27 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5701c75c-0915-4dfc-8724-e2acae037bf5 tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (893ca9e1-9e53-4d1c-a1e5-fc9d1a9f463e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:27 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5701c75c-0915-4dfc-8724-e2acae037bf5 tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (893ca9e1-9e53-4d1c-a1e5-fc9d1a9f463e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:27 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5701c75c-0915-4dfc-8724-e2acae037bf5 tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c893bf19-7a10-450b-b2fa-e45d25796896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:27 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5701c75c-0915-4dfc-8724-e2acae037bf5 tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c893bf19-7a10-450b-b2fa-e45d25796896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9576545-0200-4cb5-957f-e14be31f2682', 'volume_name': 'volume-b9576545-0200-4cb5-957f-e14be31f2682', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:27 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5701c75c-0915-4dfc-8724-e2acae037bf5 tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7b41aaf-c086-4485-9d8b-6662392502b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:27 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5701c75c-0915-4dfc-8724-e2acae037bf5 tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7b41aaf-c086-4485-9d8b-6662392502b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:27 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5701c75c-0915-4dfc-8724-e2acae037bf5 tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc707a42-6f8d-4ffc-880a-5c324c626492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:27 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-5701c75c-0915-4dfc-8724-e2acae037bf5 tempest-VolumesActionsTest-4540298 None] Volume b9576545-0200-4cb5-957f-e14be31f2682: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9576545-0200-4cb5-957f-e14be31f2682', 'volume_size': 1}
Feb 28 04:45:27 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5701c75c-0915-4dfc-8724-e2acae037bf5 tempest-VolumesActionsTest-4540298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:28 devstack sudo[88619]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6e375fcc-0f47-43a2-a414-9a0cfc9d6d75" returned: 0 in 2.445s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:28 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae698bb8-31ff-4baa-ae7d-5735ef14fade]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:28 devstack sudo[88627]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-bb30b766-ed8a-424d-99e0-bdbb916558fa tempest-VolumesCloneNegativeTest-1926358792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 2.040s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:28 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-bb30b766-ed8a-424d-99e0-bdbb916558fa tempest-VolumesCloneNegativeTest-1926358792 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:45:28 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-bb30b766-ed8a-424d-99e0-bdbb916558fa tempest-VolumesCloneNegativeTest-1926358792 None] Deleted volume successfully.
Feb 28 04:45:28 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-bb30b766-ed8a-424d-99e0-bdbb916558fa tempest-VolumesCloneNegativeTest-1926358792 None] Lock "cinder-d51eda68-2278-4f22-919b-17da508ccf5a-delete_volume" released by "delete_volume" :: held 3.871s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:28 devstack sudo[88637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f
Feb 28 04:45:28 devstack sudo[88637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:28 devstack sudo[88637]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f" returned: 0 in 0.683s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:28 devstack cinder-volume[84248]: DEBUG cinder.image.image_utils [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Image conversion details: src /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f, size 1024.00 MB, duration 2.45 sec, destination /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6e375fcc-0f47-43a2-a414-9a0cfc9d6d75 {{(pid=84248) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 28 04:45:28 devstack cinder-volume[84248]: INFO cinder.image.image_utils [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Converted 1024.00 MB image at 418.55 MB/s
Feb 28 04:45:28 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6e375fcc-0f47-43a2-a414-9a0cfc9d6d75 is being set with open permissions: ugo+rw
Feb 28 04:45:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6e375fcc-0f47-43a2-a414-9a0cfc9d6d75 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:28 devstack sudo[88642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6e375fcc-0f47-43a2-a414-9a0cfc9d6d75
Feb 28 04:45:28 devstack sudo[88642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:29 devstack sudo[88642]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6e375fcc-0f47-43a2-a414-9a0cfc9d6d75" returned: 0 in 0.442s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:29 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Lock "cinder-quobyte-6e375fcc-0f47-43a2-a414-9a0cfc9d6d75" released by "_copy_volume_from_snapshot" :: held 5.584s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:29 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Lock "cinder-quobyte-afb558ec-7c14-4d12-b8b5-f4a9f926a700-6e375fcc-0f47-43a2-a414-9a0cfc9d6d75" released by "_create_volume_from_snapshot" :: held 5.620s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.647s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5701c75c-0915-4dfc-8724-e2acae037bf5 tempest-VolumesActionsTest-4540298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.658s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:29 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-5701c75c-0915-4dfc-8724-e2acae037bf5 tempest-VolumesActionsTest-4540298 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1187166550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9576545-0200-4cb5-957f-e14be31f2682,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af27b7a098294a58b84dd04067ce0e24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:45:27Z,use_quota=True,user_id='4e66d3f79b074645a4e80b9f7a373a42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:45:29 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-5701c75c-0915-4dfc-8724-e2acae037bf5 tempest-VolumesActionsTest-4540298 None] Creating volume b9576545-0200-4cb5-957f-e14be31f2682 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:45:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5701c75c-0915-4dfc-8724-e2acae037bf5 tempest-VolumesActionsTest-4540298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5701c75c-0915-4dfc-8724-e2acae037bf5 tempest-VolumesActionsTest-4540298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:29 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-5701c75c-0915-4dfc-8724-e2acae037bf5 tempest-VolumesActionsTest-4540298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:45:29 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-5701c75c-0915-4dfc-8724-e2acae037bf5 tempest-VolumesActionsTest-4540298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:45:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5701c75c-0915-4dfc-8724-e2acae037bf5 tempest-VolumesActionsTest-4540298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:29 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-5701c75c-0915-4dfc-8724-e2acae037bf5 tempest-VolumesActionsTest-4540298 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:45:29 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-5701c75c-0915-4dfc-8724-e2acae037bf5 tempest-VolumesActionsTest-4540298 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:45:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5701c75c-0915-4dfc-8724-e2acae037bf5 tempest-VolumesActionsTest-4540298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b9576545-0200-4cb5-957f-e14be31f2682 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:29 devstack sudo[88645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b9576545-0200-4cb5-957f-e14be31f2682 1073741824
Feb 28 04:45:29 devstack sudo[88645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad1394e7-9583-4c71-bc06-4ba7e14f8978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e375fcc-0f47-43a2-a414-9a0cfc9d6d75', 'volume_size': 1, 'snapshot_id': 'afb558ec-7c14-4d12-b8b5-f4a9f926a700'}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f69324-d627-441e-a21c-c9153fdee10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:29 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Volume volume-6e375fcc-0f47-43a2-a414-9a0cfc9d6d75 (6e375fcc-0f47-43a2-a414-9a0cfc9d6d75): created successfully
Feb 28 04:45:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f69324-d627-441e-a21c-c9153fdee10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Flow 'volume_create_manager' (6332d229-c2cb-4821-9539-239a34755f6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:45:29 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-5ada2ade-e147-4275-8200-fc45db684f21 tempest-VolumesDeleteCascade-906689606 None] Created volume successfully.
Feb 28 04:45:29 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3c8937b-09fb-442a-9c25-e8b06b251ecf tempest-VolumesGetTest-507974651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:45:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b3c8937b-09fb-442a-9c25-e8b06b251ecf tempest-VolumesGetTest-507974651 None] Flow 'volume_create_manager' (d7287078-54bf-4cd3-a3b3-891042e418ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:45:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b3c8937b-09fb-442a-9c25-e8b06b251ecf tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eb00c88-bd29-4f6c-9da1-3a19c6bf87b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b3c8937b-09fb-442a-9c25-e8b06b251ecf tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eb00c88-bd29-4f6c-9da1-3a19c6bf87b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:45:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-919168282',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d263cf60-5c16-4b44-978f-64cadcd017ec,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='992ba50d9e4a432fbe7b2db9bbd34498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:45:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:45:30Z,use_quota=True,user_id='2247d4e35589438db75df793320c521a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b3c8937b-09fb-442a-9c25-e8b06b251ecf tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb5a5d1-d5ed-445d-a20c-a3a752583400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b3c8937b-09fb-442a-9c25-e8b06b251ecf tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb5a5d1-d5ed-445d-a20c-a3a752583400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b3c8937b-09fb-442a-9c25-e8b06b251ecf tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2d96bc2-cf98-4a41-905c-d773e05d88f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b3c8937b-09fb-442a-9c25-e8b06b251ecf tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2d96bc2-cf98-4a41-905c-d773e05d88f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd263cf60-5c16-4b44-978f-64cadcd017ec', 'volume_name': 'volume-d263cf60-5c16-4b44-978f-64cadcd017ec', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b3c8937b-09fb-442a-9c25-e8b06b251ecf tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f383f47-9722-438a-becd-8080acd763bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b3c8937b-09fb-442a-9c25-e8b06b251ecf tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f383f47-9722-438a-becd-8080acd763bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b3c8937b-09fb-442a-9c25-e8b06b251ecf tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44bc082f-562c-451e-9c53-517ba22145c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:29 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-b3c8937b-09fb-442a-9c25-e8b06b251ecf tempest-VolumesGetTest-507974651 None] Volume d263cf60-5c16-4b44-978f-64cadcd017ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d263cf60-5c16-4b44-978f-64cadcd017ec', 'volume_size': 1}
Feb 28 04:45:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b3c8937b-09fb-442a-9c25-e8b06b251ecf tempest-VolumesGetTest-507974651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:29 devstack sudo[88645]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5701c75c-0915-4dfc-8724-e2acae037bf5 tempest-VolumesActionsTest-4540298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b9576545-0200-4cb5-957f-e14be31f2682 1073741824" returned: 0 in 0.526s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5701c75c-0915-4dfc-8724-e2acae037bf5 tempest-VolumesActionsTest-4540298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b9576545-0200-4cb5-957f-e14be31f2682 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:30 devstack sudo[88651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b9576545-0200-4cb5-957f-e14be31f2682
Feb 28 04:45:30 devstack sudo[88651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:30 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-4d790499-551f-4d69-a798-5c7a2c6bc856 tempest-VolumesDeleteCascade-906689606 None] Acquiring lock "cinder-6456e9be-064e-4b81-8778-ce4c4a7fe56f-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:30 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-4d790499-551f-4d69-a798-5c7a2c6bc856 tempest-VolumesDeleteCascade-906689606 None] Lock "cinder-6456e9be-064e-4b81-8778-ce4c4a7fe56f-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:30 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-4d790499-551f-4d69-a798-5c7a2c6bc856 tempest-VolumesDeleteCascade-906689606 None] Performing cascade delete. {{(pid=84248) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Feb 28 04:45:30 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-4d790499-551f-4d69-a798-5c7a2c6bc856 tempest-VolumesDeleteCascade-906689606 None] Acquiring lock "cinder-afb558ec-7c14-4d12-b8b5-f4a9f926a700-delete_snapshot" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:30 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-4d790499-551f-4d69-a798-5c7a2c6bc856 tempest-VolumesDeleteCascade-906689606 None] Lock "cinder-afb558ec-7c14-4d12-b8b5-f4a9f926a700-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:30 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-4d790499-551f-4d69-a798-5c7a2c6bc856 tempest-VolumesDeleteCascade-906689606 None] Acquiring lock "cinder-quobyte-6456e9be-064e-4b81-8778-ce4c4a7fe56f" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:30 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-4d790499-551f-4d69-a798-5c7a2c6bc856 tempest-VolumesDeleteCascade-906689606 None] Lock "cinder-quobyte-6456e9be-064e-4b81-8778-ce4c4a7fe56f" acquired by "delete_snapshot" :: waited 0.007s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:30 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-4d790499-551f-4d69-a798-5c7a2c6bc856 tempest-VolumesDeleteCascade-906689606 None] Acquiring lock "cinder-quobyte-afb558ec-7c14-4d12-b8b5-f4a9f926a700" by "_delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:30 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-4d790499-551f-4d69-a798-5c7a2c6bc856 tempest-VolumesDeleteCascade-906689606 None] Lock "cinder-quobyte-afb558ec-7c14-4d12-b8b5-f4a9f926a700" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:30 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-4d790499-551f-4d69-a798-5c7a2c6bc856 tempest-VolumesDeleteCascade-906689606 None] Deleting offline snapshot afb558ec-7c14-4d12-b8b5-f4a9f926a700 of volume 6456e9be-064e-4b81-8778-ce4c4a7fe56f {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 04:45:30 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-4d790499-551f-4d69-a798-5c7a2c6bc856 tempest-VolumesDeleteCascade-906689606 None] snapshot_file for this snap is: volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f.afb558ec-7c14-4d12-b8b5-f4a9f926a700 {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 04:45:30 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[670d6a85-b9b7-40d1-b88b-22c873c60b48]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4d790499-551f-4d69-a798-5c7a2c6bc856 tempest-VolumesDeleteCascade-906689606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f.afb558ec-7c14-4d12-b8b5-f4a9f926a700 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:30 devstack sudo[88653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f.afb558ec-7c14-4d12-b8b5-f4a9f926a700
Feb 28 04:45:30 devstack sudo[88653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:30 devstack sudo[88651]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5701c75c-0915-4dfc-8724-e2acae037bf5 tempest-VolumesActionsTest-4540298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b9576545-0200-4cb5-957f-e14be31f2682" returned: 0 in 0.441s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:30 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-5701c75c-0915-4dfc-8724-e2acae037bf5 tempest-VolumesActionsTest-4540298 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:45:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5701c75c-0915-4dfc-8724-e2acae037bf5 tempest-VolumesActionsTest-4540298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b3c8937b-09fb-442a-9c25-e8b06b251ecf tempest-VolumesGetTest-507974651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.549s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:30 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-b3c8937b-09fb-442a-9c25-e8b06b251ecf tempest-VolumesGetTest-507974651 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:45:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-919168282',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d263cf60-5c16-4b44-978f-64cadcd017ec,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='992ba50d9e4a432fbe7b2db9bbd34498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:45:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:45:30Z,use_quota=True,user_id='2247d4e35589438db75df793320c521a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:45:30 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-b3c8937b-09fb-442a-9c25-e8b06b251ecf tempest-VolumesGetTest-507974651 None] Creating volume d263cf60-5c16-4b44-978f-64cadcd017ec {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:45:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b3c8937b-09fb-442a-9c25-e8b06b251ecf tempest-VolumesGetTest-507974651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b3c8937b-09fb-442a-9c25-e8b06b251ecf tempest-VolumesGetTest-507974651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:30 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-b3c8937b-09fb-442a-9c25-e8b06b251ecf tempest-VolumesGetTest-507974651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:45:30 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-b3c8937b-09fb-442a-9c25-e8b06b251ecf tempest-VolumesGetTest-507974651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:45:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b3c8937b-09fb-442a-9c25-e8b06b251ecf tempest-VolumesGetTest-507974651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:30 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-b3c8937b-09fb-442a-9c25-e8b06b251ecf tempest-VolumesGetTest-507974651 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:45:30 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-b3c8937b-09fb-442a-9c25-e8b06b251ecf tempest-VolumesGetTest-507974651 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:45:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b3c8937b-09fb-442a-9c25-e8b06b251ecf tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-d263cf60-5c16-4b44-978f-64cadcd017ec 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:30 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5701c75c-0915-4dfc-8724-e2acae037bf5 tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc707a42-6f8d-4ffc-880a-5c324c626492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9576545-0200-4cb5-957f-e14be31f2682', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:30 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5701c75c-0915-4dfc-8724-e2acae037bf5 tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bdd40f2-65f8-4d56-8e4f-25f9f15bb573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:30 devstack sudo[88656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-d263cf60-5c16-4b44-978f-64cadcd017ec 1073741824
Feb 28 04:45:30 devstack sudo[88656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:30 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-5701c75c-0915-4dfc-8724-e2acae037bf5 tempest-VolumesActionsTest-4540298 None] Volume volume-b9576545-0200-4cb5-957f-e14be31f2682 (b9576545-0200-4cb5-957f-e14be31f2682): created successfully
Feb 28 04:45:30 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5701c75c-0915-4dfc-8724-e2acae037bf5 tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bdd40f2-65f8-4d56-8e4f-25f9f15bb573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:30 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5701c75c-0915-4dfc-8724-e2acae037bf5 tempest-VolumesActionsTest-4540298 None] Flow 'volume_create_manager' (28bf7d02-85b0-4ab1-a8df-eecd9ae20a45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:45:30 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-5701c75c-0915-4dfc-8724-e2acae037bf5 tempest-VolumesActionsTest-4540298 None] Created volume successfully.
Feb 28 04:45:30 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-99336abf-e77c-4131-8587-c6918c40dcb2 tempest-VolumesActionsTest-275771739 None] Acquiring lock "cinder-b9576545-0200-4cb5-957f-e14be31f2682-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:30 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-99336abf-e77c-4131-8587-c6918c40dcb2 tempest-VolumesActionsTest-275771739 None] Lock "cinder-b9576545-0200-4cb5-957f-e14be31f2682-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:30 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-99336abf-e77c-4131-8587-c6918c40dcb2 tempest-VolumesActionsTest-275771739 None] Acquiring lock "cinder-quobyte-b9576545-0200-4cb5-957f-e14be31f2682" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:30 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-99336abf-e77c-4131-8587-c6918c40dcb2 tempest-VolumesActionsTest-275771739 None] Lock "cinder-quobyte-b9576545-0200-4cb5-957f-e14be31f2682" acquired by "delete_volume" :: waited 0.008s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:30 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea3a3d3-0721-4505-b1f8-66b29378ad1d]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-99336abf-e77c-4131-8587-c6918c40dcb2 tempest-VolumesActionsTest-275771739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b9576545-0200-4cb5-957f-e14be31f2682 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:30 devstack sudo[88658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b9576545-0200-4cb5-957f-e14be31f2682
Feb 28 04:45:30 devstack sudo[88658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:30 devstack sudo[88653]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4d790499-551f-4d69-a798-5c7a2c6bc856 tempest-VolumesDeleteCascade-906689606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f.afb558ec-7c14-4d12-b8b5-f4a9f926a700" returned: 0 in 0.571s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:30 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-4d790499-551f-4d69-a798-5c7a2c6bc856 tempest-VolumesDeleteCascade-906689606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:45:30 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a57f95e-da2a-460a-8a27-f36329df656f]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4d790499-551f-4d69-a798-5c7a2c6bc856 tempest-VolumesDeleteCascade-906689606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:31 devstack sudo[88666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f
Feb 28 04:45:31 devstack sudo[88666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:31 devstack sudo[88656]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b3c8937b-09fb-442a-9c25-e8b06b251ecf tempest-VolumesGetTest-507974651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-d263cf60-5c16-4b44-978f-64cadcd017ec 1073741824" returned: 0 in 0.602s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b3c8937b-09fb-442a-9c25-e8b06b251ecf tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-d263cf60-5c16-4b44-978f-64cadcd017ec {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:31 devstack sudo[88668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-d263cf60-5c16-4b44-978f-64cadcd017ec
Feb 28 04:45:31 devstack sudo[88668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:31 devstack sudo[88658]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-99336abf-e77c-4131-8587-c6918c40dcb2 tempest-VolumesActionsTest-275771739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b9576545-0200-4cb5-957f-e14be31f2682" returned: 0 in 0.513s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-99336abf-e77c-4131-8587-c6918c40dcb2 tempest-VolumesActionsTest-275771739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b9576545-0200-4cb5-957f-e14be31f2682 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:31 devstack sudo[88673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b9576545-0200-4cb5-957f-e14be31f2682
Feb 28 04:45:31 devstack sudo[88673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:31 devstack sudo[88666]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4d790499-551f-4d69-a798-5c7a2c6bc856 tempest-VolumesDeleteCascade-906689606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f" returned: 0 in 0.538s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4d790499-551f-4d69-a798-5c7a2c6bc856 tempest-VolumesDeleteCascade-906689606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f.afb558ec-7c14-4d12-b8b5-f4a9f926a700 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:31 devstack sudo[88679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f.afb558ec-7c14-4d12-b8b5-f4a9f926a700
Feb 28 04:45:31 devstack sudo[88679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:31 devstack sudo[88668]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b3c8937b-09fb-442a-9c25-e8b06b251ecf tempest-VolumesGetTest-507974651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-d263cf60-5c16-4b44-978f-64cadcd017ec" returned: 0 in 0.408s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:31 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-b3c8937b-09fb-442a-9c25-e8b06b251ecf tempest-VolumesGetTest-507974651 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:45:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b3c8937b-09fb-442a-9c25-e8b06b251ecf tempest-VolumesGetTest-507974651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:31 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b3c8937b-09fb-442a-9c25-e8b06b251ecf tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44bc082f-562c-451e-9c53-517ba22145c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d263cf60-5c16-4b44-978f-64cadcd017ec', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:31 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b3c8937b-09fb-442a-9c25-e8b06b251ecf tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ecae108-5ac6-4a6f-a3af-4b7dc3609e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:31 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-b3c8937b-09fb-442a-9c25-e8b06b251ecf tempest-VolumesGetTest-507974651 None] Volume volume-d263cf60-5c16-4b44-978f-64cadcd017ec (d263cf60-5c16-4b44-978f-64cadcd017ec): created successfully
Feb 28 04:45:31 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b3c8937b-09fb-442a-9c25-e8b06b251ecf tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ecae108-5ac6-4a6f-a3af-4b7dc3609e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:31 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b3c8937b-09fb-442a-9c25-e8b06b251ecf tempest-VolumesGetTest-507974651 None] Flow 'volume_create_manager' (d7287078-54bf-4cd3-a3b3-891042e418ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:45:31 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-b3c8937b-09fb-442a-9c25-e8b06b251ecf tempest-VolumesGetTest-507974651 None] Created volume successfully.
Feb 28 04:45:31 devstack sudo[88673]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-99336abf-e77c-4131-8587-c6918c40dcb2 tempest-VolumesActionsTest-275771739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b9576545-0200-4cb5-957f-e14be31f2682" returned: 0 in 0.422s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:31 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-99336abf-e77c-4131-8587-c6918c40dcb2 tempest-VolumesActionsTest-275771739 None] Lock "cinder-quobyte-b9576545-0200-4cb5-957f-e14be31f2682" released by "delete_volume" :: held 0.967s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:31 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-99336abf-e77c-4131-8587-c6918c40dcb2 tempest-VolumesActionsTest-275771739 None] Created reservations ['95a5425a-51a0-4b99-badb-72e42dab4382', 'da6a2d95-f776-4752-bd2a-c3d7053cecaa', '1fc13410-eabd-4910-b940-5db9b8feecd8', 'e5ead10e-dfae-4463-b9a0-a4c57a92a310'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:45:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-99336abf-e77c-4131-8587-c6918c40dcb2 tempest-VolumesActionsTest-275771739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-99336abf-e77c-4131-8587-c6918c40dcb2 tempest-VolumesActionsTest-275771739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:31 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-99336abf-e77c-4131-8587-c6918c40dcb2 tempest-VolumesActionsTest-275771739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:45:31 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-99336abf-e77c-4131-8587-c6918c40dcb2 tempest-VolumesActionsTest-275771739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:45:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-99336abf-e77c-4131-8587-c6918c40dcb2 tempest-VolumesActionsTest-275771739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-99336abf-e77c-4131-8587-c6918c40dcb2 tempest-VolumesActionsTest-275771739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:31 devstack sudo[88682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:45:31 devstack sudo[88682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:32 devstack sudo[88679]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4d790499-551f-4d69-a798-5c7a2c6bc856 tempest-VolumesDeleteCascade-906689606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f.afb558ec-7c14-4d12-b8b5-f4a9f926a700" returned: 0 in 0.632s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4d790499-551f-4d69-a798-5c7a2c6bc856 tempest-VolumesDeleteCascade-906689606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f.afb558ec-7c14-4d12-b8b5-f4a9f926a700 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:32 devstack sudo[88687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f.afb558ec-7c14-4d12-b8b5-f4a9f926a700
Feb 28 04:45:32 devstack sudo[88687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc4feeef-ac8f-41ef-a5d0-ae2db098aed2 tempest-VolumesActionsTest-4540298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-dc4feeef-ac8f-41ef-a5d0-ae2db098aed2 tempest-VolumesActionsTest-4540298 None] Flow 'volume_create_manager' (901ea8a4-8de4-4ae9-93d4-c2d727544846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-dc4feeef-ac8f-41ef-a5d0-ae2db098aed2 tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (943686e1-0ef5-4d24-a5f9-5bf77b5118fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-dc4feeef-ac8f-41ef-a5d0-ae2db098aed2 tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (943686e1-0ef5-4d24-a5f9-5bf77b5118fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1548643576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a5791b7-71df-4b03-b6aa-937fddc58da0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af27b7a098294a58b84dd04067ce0e24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:45:32Z,use_quota=True,user_id='4e66d3f79b074645a4e80b9f7a373a42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-dc4feeef-ac8f-41ef-a5d0-ae2db098aed2 tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adf04df1-e0f5-4d7d-af03-a86c534f9ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-dc4feeef-ac8f-41ef-a5d0-ae2db098aed2 tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adf04df1-e0f5-4d7d-af03-a86c534f9ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-dc4feeef-ac8f-41ef-a5d0-ae2db098aed2 tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f50d356e-abe1-4389-9058-16aeab83c951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-dc4feeef-ac8f-41ef-a5d0-ae2db098aed2 tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f50d356e-abe1-4389-9058-16aeab83c951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a5791b7-71df-4b03-b6aa-937fddc58da0', 'volume_name': 'volume-1a5791b7-71df-4b03-b6aa-937fddc58da0', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-dc4feeef-ac8f-41ef-a5d0-ae2db098aed2 tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8b1fa5e-6e42-4718-a5b7-25b791637d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-dc4feeef-ac8f-41ef-a5d0-ae2db098aed2 tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8b1fa5e-6e42-4718-a5b7-25b791637d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-dc4feeef-ac8f-41ef-a5d0-ae2db098aed2 tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0c1944e-d404-4c7c-856b-8e74a666338b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:32 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-dc4feeef-ac8f-41ef-a5d0-ae2db098aed2 tempest-VolumesActionsTest-4540298 None] Volume 1a5791b7-71df-4b03-b6aa-937fddc58da0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a5791b7-71df-4b03-b6aa-937fddc58da0', 'volume_size': 1}
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-dc4feeef-ac8f-41ef-a5d0-ae2db098aed2 tempest-VolumesActionsTest-4540298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-dc4feeef-ac8f-41ef-a5d0-ae2db098aed2 tempest-VolumesActionsTest-4540298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:32 devstack sudo[88682]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-dc4feeef-ac8f-41ef-a5d0-ae2db098aed2 tempest-VolumesActionsTest-4540298 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1548643576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a5791b7-71df-4b03-b6aa-937fddc58da0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af27b7a098294a58b84dd04067ce0e24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:45:32Z,use_quota=True,user_id='4e66d3f79b074645a4e80b9f7a373a42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-dc4feeef-ac8f-41ef-a5d0-ae2db098aed2 tempest-VolumesActionsTest-4540298 None] Creating volume 1a5791b7-71df-4b03-b6aa-937fddc58da0 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-dc4feeef-ac8f-41ef-a5d0-ae2db098aed2 tempest-VolumesActionsTest-4540298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-dc4feeef-ac8f-41ef-a5d0-ae2db098aed2 tempest-VolumesActionsTest-4540298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-dc4feeef-ac8f-41ef-a5d0-ae2db098aed2 tempest-VolumesActionsTest-4540298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-dc4feeef-ac8f-41ef-a5d0-ae2db098aed2 tempest-VolumesActionsTest-4540298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-dc4feeef-ac8f-41ef-a5d0-ae2db098aed2 tempest-VolumesActionsTest-4540298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-dc4feeef-ac8f-41ef-a5d0-ae2db098aed2 tempest-VolumesActionsTest-4540298 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:45:32 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-dc4feeef-ac8f-41ef-a5d0-ae2db098aed2 tempest-VolumesActionsTest-4540298 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dc4feeef-ac8f-41ef-a5d0-ae2db098aed2 tempest-VolumesActionsTest-4540298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1a5791b7-71df-4b03-b6aa-937fddc58da0 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-99336abf-e77c-4131-8587-c6918c40dcb2 tempest-VolumesActionsTest-275771739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.693s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-99336abf-e77c-4131-8587-c6918c40dcb2 tempest-VolumesActionsTest-275771739 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:45:32 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-99336abf-e77c-4131-8587-c6918c40dcb2 tempest-VolumesActionsTest-275771739 None] Deleted volume successfully.
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-99336abf-e77c-4131-8587-c6918c40dcb2 tempest-VolumesActionsTest-275771739 None] Lock "cinder-b9576545-0200-4cb5-957f-e14be31f2682-delete_volume" released by "delete_volume" :: held 1.816s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:32 devstack sudo[88690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1a5791b7-71df-4b03-b6aa-937fddc58da0 1073741824
Feb 28 04:45:32 devstack sudo[88690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-aee6f225-4278-4213-9b78-382c2d8d07ce tempest-VolumesGetTest-507974651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-aee6f225-4278-4213-9b78-382c2d8d07ce tempest-VolumesGetTest-507974651 None] Flow 'volume_create_manager' (c3ecca9f-5d06-480e-bd62-5ed317d2fd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-aee6f225-4278-4213-9b78-382c2d8d07ce tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (961fbaf4-c9ce-4613-b13a-1dbcfb7f9017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-aee6f225-4278-4213-9b78-382c2d8d07ce tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (961fbaf4-c9ce-4613-b13a-1dbcfb7f9017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:45:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-109701439',display_name='tempest-VolumesGetTest-Volume-1918798277',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c593bd40-dc03-40fc-8804-386d25ee2165,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='992ba50d9e4a432fbe7b2db9bbd34498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:45:33Z,use_quota=True,user_id='2247d4e35589438db75df793320c521a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-aee6f225-4278-4213-9b78-382c2d8d07ce tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae25a245-c3bd-447b-8697-1b50ab1f566f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-aee6f225-4278-4213-9b78-382c2d8d07ce tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae25a245-c3bd-447b-8697-1b50ab1f566f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-aee6f225-4278-4213-9b78-382c2d8d07ce tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4845469b-9d68-492f-8834-42743c0853b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-aee6f225-4278-4213-9b78-382c2d8d07ce tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4845469b-9d68-492f-8834-42743c0853b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c593bd40-dc03-40fc-8804-386d25ee2165', 'volume_name': 'volume-c593bd40-dc03-40fc-8804-386d25ee2165', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-aee6f225-4278-4213-9b78-382c2d8d07ce tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (357544cf-7bb4-4720-9fb5-338fa2c77c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-aee6f225-4278-4213-9b78-382c2d8d07ce tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (357544cf-7bb4-4720-9fb5-338fa2c77c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-aee6f225-4278-4213-9b78-382c2d8d07ce tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de2627d-4ee7-4384-826e-d332545b522a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:32 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-aee6f225-4278-4213-9b78-382c2d8d07ce tempest-VolumesGetTest-507974651 None] Volume c593bd40-dc03-40fc-8804-386d25ee2165: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c593bd40-dc03-40fc-8804-386d25ee2165', 'volume_size': 1}
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-aee6f225-4278-4213-9b78-382c2d8d07ce tempest-VolumesGetTest-507974651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:32 devstack sudo[88687]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4d790499-551f-4d69-a798-5c7a2c6bc856 tempest-VolumesDeleteCascade-906689606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f.afb558ec-7c14-4d12-b8b5-f4a9f926a700" returned: 0 in 0.555s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-4d790499-551f-4d69-a798-5c7a2c6bc856 tempest-VolumesDeleteCascade-906689606 None] Lock "cinder-quobyte-afb558ec-7c14-4d12-b8b5-f4a9f926a700" released by "_delete_snapshot" :: held 2.350s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-4d790499-551f-4d69-a798-5c7a2c6bc856 tempest-VolumesDeleteCascade-906689606 None] Lock "cinder-quobyte-6456e9be-064e-4b81-8778-ce4c4a7fe56f" released by "delete_snapshot" :: held 2.359s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-4d790499-551f-4d69-a798-5c7a2c6bc856 tempest-VolumesDeleteCascade-906689606 None] Created reservations ['b77f9a28-48c2-4f3b-b401-fda04ffb783b', 'bdef3822-dda1-4247-9c35-934106fd8c92', '0dfdb741-b9bb-43f1-a106-7825c802f949', '5d2f7896-d5b1-49fe-8f01-48624aeb8052'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:45:32 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-4d790499-551f-4d69-a798-5c7a2c6bc856 tempest-VolumesDeleteCascade-906689606 None] Delete snapshot completed successfully.
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-4d790499-551f-4d69-a798-5c7a2c6bc856 tempest-VolumesDeleteCascade-906689606 None] Lock "cinder-afb558ec-7c14-4d12-b8b5-f4a9f926a700-delete_snapshot" released by "delete_snapshot" :: held 2.457s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-4d790499-551f-4d69-a798-5c7a2c6bc856 tempest-VolumesDeleteCascade-906689606 None] Snapshots deleted, issuing volume delete {{(pid=84248) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-4d790499-551f-4d69-a798-5c7a2c6bc856 tempest-VolumesDeleteCascade-906689606 None] Acquiring lock "cinder-quobyte-6456e9be-064e-4b81-8778-ce4c4a7fe56f" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-4d790499-551f-4d69-a798-5c7a2c6bc856 tempest-VolumesDeleteCascade-906689606 None] Lock "cinder-quobyte-6456e9be-064e-4b81-8778-ce4c4a7fe56f" acquired by "delete_volume" :: waited 0.007s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b997380-f4f2-4d2b-9bca-57a1edc3c2d0]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4d790499-551f-4d69-a798-5c7a2c6bc856 tempest-VolumesDeleteCascade-906689606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:32 devstack sudo[88694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f
Feb 28 04:45:32 devstack sudo[88694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:33 devstack sudo[88690]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dc4feeef-ac8f-41ef-a5d0-ae2db098aed2 tempest-VolumesActionsTest-4540298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1a5791b7-71df-4b03-b6aa-937fddc58da0 1073741824" returned: 0 in 0.571s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dc4feeef-ac8f-41ef-a5d0-ae2db098aed2 tempest-VolumesActionsTest-4540298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1a5791b7-71df-4b03-b6aa-937fddc58da0 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:33 devstack sudo[88699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1a5791b7-71df-4b03-b6aa-937fddc58da0
Feb 28 04:45:33 devstack sudo[88699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:33 devstack sudo[88694]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4d790499-551f-4d69-a798-5c7a2c6bc856 tempest-VolumesDeleteCascade-906689606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f" returned: 0 in 0.542s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4d790499-551f-4d69-a798-5c7a2c6bc856 tempest-VolumesDeleteCascade-906689606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:33 devstack sudo[88704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f
Feb 28 04:45:33 devstack sudo[88704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:33 devstack sudo[88699]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dc4feeef-ac8f-41ef-a5d0-ae2db098aed2 tempest-VolumesActionsTest-4540298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1a5791b7-71df-4b03-b6aa-937fddc58da0" returned: 0 in 0.508s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:33 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-dc4feeef-ac8f-41ef-a5d0-ae2db098aed2 tempest-VolumesActionsTest-4540298 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:45:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-dc4feeef-ac8f-41ef-a5d0-ae2db098aed2 tempest-VolumesActionsTest-4540298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-aee6f225-4278-4213-9b78-382c2d8d07ce tempest-VolumesGetTest-507974651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.951s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:33 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-aee6f225-4278-4213-9b78-382c2d8d07ce tempest-VolumesGetTest-507974651 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:45:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-109701439',display_name='tempest-VolumesGetTest-Volume-1918798277',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c593bd40-dc03-40fc-8804-386d25ee2165,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='992ba50d9e4a432fbe7b2db9bbd34498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:45:33Z,use_quota=True,user_id='2247d4e35589438db75df793320c521a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:45:33 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-aee6f225-4278-4213-9b78-382c2d8d07ce tempest-VolumesGetTest-507974651 None] Creating volume c593bd40-dc03-40fc-8804-386d25ee2165 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:45:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-aee6f225-4278-4213-9b78-382c2d8d07ce tempest-VolumesGetTest-507974651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-aee6f225-4278-4213-9b78-382c2d8d07ce tempest-VolumesGetTest-507974651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:33 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-aee6f225-4278-4213-9b78-382c2d8d07ce tempest-VolumesGetTest-507974651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:45:33 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-aee6f225-4278-4213-9b78-382c2d8d07ce tempest-VolumesGetTest-507974651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:45:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-aee6f225-4278-4213-9b78-382c2d8d07ce tempest-VolumesGetTest-507974651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:33 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-aee6f225-4278-4213-9b78-382c2d8d07ce tempest-VolumesGetTest-507974651 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:45:33 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-aee6f225-4278-4213-9b78-382c2d8d07ce tempest-VolumesGetTest-507974651 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:45:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-aee6f225-4278-4213-9b78-382c2d8d07ce tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c593bd40-dc03-40fc-8804-386d25ee2165 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:33 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-dc4feeef-ac8f-41ef-a5d0-ae2db098aed2 tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0c1944e-d404-4c7c-856b-8e74a666338b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a5791b7-71df-4b03-b6aa-937fddc58da0', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:33 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-dc4feeef-ac8f-41ef-a5d0-ae2db098aed2 tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb4f5fc3-5196-4e87-8652-bb57c408ea91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:33 devstack sudo[88707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c593bd40-dc03-40fc-8804-386d25ee2165 1073741824
Feb 28 04:45:33 devstack sudo[88707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:33 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-dc4feeef-ac8f-41ef-a5d0-ae2db098aed2 tempest-VolumesActionsTest-4540298 None] Volume volume-1a5791b7-71df-4b03-b6aa-937fddc58da0 (1a5791b7-71df-4b03-b6aa-937fddc58da0): created successfully
Feb 28 04:45:33 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-dc4feeef-ac8f-41ef-a5d0-ae2db098aed2 tempest-VolumesActionsTest-4540298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb4f5fc3-5196-4e87-8652-bb57c408ea91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:33 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-dc4feeef-ac8f-41ef-a5d0-ae2db098aed2 tempest-VolumesActionsTest-4540298 None] Flow 'volume_create_manager' (901ea8a4-8de4-4ae9-93d4-c2d727544846) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:45:33 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-dc4feeef-ac8f-41ef-a5d0-ae2db098aed2 tempest-VolumesActionsTest-4540298 None] Created volume successfully.
Feb 28 04:45:33 devstack sudo[88704]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4d790499-551f-4d69-a798-5c7a2c6bc856 tempest-VolumesDeleteCascade-906689606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6456e9be-064e-4b81-8778-ce4c4a7fe56f" returned: 0 in 0.466s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:33 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-4d790499-551f-4d69-a798-5c7a2c6bc856 tempest-VolumesDeleteCascade-906689606 None] Lock "cinder-quobyte-6456e9be-064e-4b81-8778-ce4c4a7fe56f" released by "delete_volume" :: held 1.058s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:33 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-4d790499-551f-4d69-a798-5c7a2c6bc856 tempest-VolumesDeleteCascade-906689606 None] Created reservations ['7b067906-8dff-4720-b9ed-9d3bc3a3b161', '2b8db74d-0243-4c1e-8a9c-642deda93f58', 'f674a42d-db76-44e7-a26d-636e8fdede9f', '906aa803-f00b-4d1a-a1a0-479676ec5117'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:45:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-4d790499-551f-4d69-a798-5c7a2c6bc856 tempest-VolumesDeleteCascade-906689606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-4d790499-551f-4d69-a798-5c7a2c6bc856 tempest-VolumesDeleteCascade-906689606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:33 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-4d790499-551f-4d69-a798-5c7a2c6bc856 tempest-VolumesDeleteCascade-906689606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:45:33 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-4d790499-551f-4d69-a798-5c7a2c6bc856 tempest-VolumesDeleteCascade-906689606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:45:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-4d790499-551f-4d69-a798-5c7a2c6bc856 tempest-VolumesDeleteCascade-906689606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4d790499-551f-4d69-a798-5c7a2c6bc856 tempest-VolumesDeleteCascade-906689606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:33 devstack sudo[88710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:45:33 devstack sudo[88710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:34 devstack sudo[88707]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-aee6f225-4278-4213-9b78-382c2d8d07ce tempest-VolumesGetTest-507974651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c593bd40-dc03-40fc-8804-386d25ee2165 1073741824" returned: 0 in 0.561s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-aee6f225-4278-4213-9b78-382c2d8d07ce tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c593bd40-dc03-40fc-8804-386d25ee2165 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:34 devstack sudo[88715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c593bd40-dc03-40fc-8804-386d25ee2165
Feb 28 04:45:34 devstack sudo[88715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:34 devstack sudo[88710]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4d790499-551f-4d69-a798-5c7a2c6bc856 tempest-VolumesDeleteCascade-906689606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.472s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:34 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-4d790499-551f-4d69-a798-5c7a2c6bc856 tempest-VolumesDeleteCascade-906689606 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:45:34 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-4d790499-551f-4d69-a798-5c7a2c6bc856 tempest-VolumesDeleteCascade-906689606 None] Deleted volume successfully.
Feb 28 04:45:34 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-4d790499-551f-4d69-a798-5c7a2c6bc856 tempest-VolumesDeleteCascade-906689606 None] Lock "cinder-6456e9be-064e-4b81-8778-ce4c4a7fe56f-delete_volume" released by "delete_volume" :: held 4.135s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:34 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1885f0aa-fb3e-4a5e-88d2-c245789d823b tempest-VolumesDeleteCascade-906689606 None] Acquiring lock "cinder-6e375fcc-0f47-43a2-a414-9a0cfc9d6d75-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:34 devstack sudo[88715]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:34 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1885f0aa-fb3e-4a5e-88d2-c245789d823b tempest-VolumesDeleteCascade-906689606 None] Lock "cinder-6e375fcc-0f47-43a2-a414-9a0cfc9d6d75-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-aee6f225-4278-4213-9b78-382c2d8d07ce tempest-VolumesGetTest-507974651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c593bd40-dc03-40fc-8804-386d25ee2165" returned: 0 in 0.553s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:34 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-aee6f225-4278-4213-9b78-382c2d8d07ce tempest-VolumesGetTest-507974651 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:45:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-aee6f225-4278-4213-9b78-382c2d8d07ce tempest-VolumesGetTest-507974651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:34 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-aee6f225-4278-4213-9b78-382c2d8d07ce tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de2627d-4ee7-4384-826e-d332545b522a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c593bd40-dc03-40fc-8804-386d25ee2165', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:34 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-aee6f225-4278-4213-9b78-382c2d8d07ce tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aab137cb-47d8-45bf-a3ca-e1bc8d037992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:34 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-aee6f225-4278-4213-9b78-382c2d8d07ce tempest-VolumesGetTest-507974651 None] Volume volume-c593bd40-dc03-40fc-8804-386d25ee2165 (c593bd40-dc03-40fc-8804-386d25ee2165): created successfully
Feb 28 04:45:34 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-aee6f225-4278-4213-9b78-382c2d8d07ce tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aab137cb-47d8-45bf-a3ca-e1bc8d037992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:34 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-aee6f225-4278-4213-9b78-382c2d8d07ce tempest-VolumesGetTest-507974651 None] Flow 'volume_create_manager' (c3ecca9f-5d06-480e-bd62-5ed317d2fd40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:45:34 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-aee6f225-4278-4213-9b78-382c2d8d07ce tempest-VolumesGetTest-507974651 None] Created volume successfully.
Feb 28 04:45:34 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1885f0aa-fb3e-4a5e-88d2-c245789d823b tempest-VolumesDeleteCascade-906689606 None] Acquiring lock "cinder-quobyte-6e375fcc-0f47-43a2-a414-9a0cfc9d6d75" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:34 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1885f0aa-fb3e-4a5e-88d2-c245789d823b tempest-VolumesDeleteCascade-906689606 None] Lock "cinder-quobyte-6e375fcc-0f47-43a2-a414-9a0cfc9d6d75" acquired by "delete_volume" :: waited 0.012s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:34 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ac1072-5941-4a23-b8c1-df1715cb8491]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1885f0aa-fb3e-4a5e-88d2-c245789d823b tempest-VolumesDeleteCascade-906689606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6e375fcc-0f47-43a2-a414-9a0cfc9d6d75 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:34 devstack sudo[88720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6e375fcc-0f47-43a2-a414-9a0cfc9d6d75
Feb 28 04:45:34 devstack sudo[88720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:35 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-9646d63a-39ac-43f0-971d-85736e12597e tempest-VolumesActionsTest-4540298 None] Acquiring lock "cinder-1a5791b7-71df-4b03-b6aa-937fddc58da0-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:35 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-9646d63a-39ac-43f0-971d-85736e12597e tempest-VolumesActionsTest-4540298 None] Lock "cinder-1a5791b7-71df-4b03-b6aa-937fddc58da0-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:35 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-9646d63a-39ac-43f0-971d-85736e12597e tempest-VolumesActionsTest-4540298 None] Acquiring lock "cinder-quobyte-1a5791b7-71df-4b03-b6aa-937fddc58da0" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:35 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-9646d63a-39ac-43f0-971d-85736e12597e tempest-VolumesActionsTest-4540298 None] Lock "cinder-quobyte-1a5791b7-71df-4b03-b6aa-937fddc58da0" acquired by "delete_volume" :: waited 0.009s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:35 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d3193e-7ffa-4411-bdf0-791c53256b55]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9646d63a-39ac-43f0-971d-85736e12597e tempest-VolumesActionsTest-4540298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1a5791b7-71df-4b03-b6aa-937fddc58da0 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:35 devstack sudo[88720]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1885f0aa-fb3e-4a5e-88d2-c245789d823b tempest-VolumesDeleteCascade-906689606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6e375fcc-0f47-43a2-a414-9a0cfc9d6d75" returned: 0 in 0.559s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1885f0aa-fb3e-4a5e-88d2-c245789d823b tempest-VolumesDeleteCascade-906689606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6e375fcc-0f47-43a2-a414-9a0cfc9d6d75 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:35 devstack sudo[88726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6e375fcc-0f47-43a2-a414-9a0cfc9d6d75
Feb 28 04:45:35 devstack sudo[88726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:35 devstack sudo[88725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1a5791b7-71df-4b03-b6aa-937fddc58da0
Feb 28 04:45:35 devstack sudo[88725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:35 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-65feaf90-dcbe-42a4-9a49-1833d8862734 tempest-VolumesGetTest-507974651 None] Acquiring lock "cinder-c593bd40-dc03-40fc-8804-386d25ee2165-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:35 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-65feaf90-dcbe-42a4-9a49-1833d8862734 tempest-VolumesGetTest-507974651 None] Lock "cinder-c593bd40-dc03-40fc-8804-386d25ee2165-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:35 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-65feaf90-dcbe-42a4-9a49-1833d8862734 tempest-VolumesGetTest-507974651 None] Acquiring lock "cinder-quobyte-c593bd40-dc03-40fc-8804-386d25ee2165" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:35 devstack sudo[88726]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:35 devstack sudo[88725]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1885f0aa-fb3e-4a5e-88d2-c245789d823b tempest-VolumesDeleteCascade-906689606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6e375fcc-0f47-43a2-a414-9a0cfc9d6d75" returned: 0 in 0.536s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:35 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-65feaf90-dcbe-42a4-9a49-1833d8862734 tempest-VolumesGetTest-507974651 None] Lock "cinder-quobyte-c593bd40-dc03-40fc-8804-386d25ee2165" acquired by "delete_volume" :: waited 0.013s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9646d63a-39ac-43f0-971d-85736e12597e tempest-VolumesActionsTest-4540298 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1a5791b7-71df-4b03-b6aa-937fddc58da0" returned: 0 in 0.578s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9646d63a-39ac-43f0-971d-85736e12597e tempest-VolumesActionsTest-4540298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1a5791b7-71df-4b03-b6aa-937fddc58da0 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:35 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1885f0aa-fb3e-4a5e-88d2-c245789d823b tempest-VolumesDeleteCascade-906689606 None] Lock "cinder-quobyte-6e375fcc-0f47-43a2-a414-9a0cfc9d6d75" released by "delete_volume" :: held 1.140s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:35 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d39276e-9dc7-4ba0-98ed-efa60edaff15]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-65feaf90-dcbe-42a4-9a49-1833d8862734 tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c593bd40-dc03-40fc-8804-386d25ee2165 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:35 devstack sudo[88733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1a5791b7-71df-4b03-b6aa-937fddc58da0
Feb 28 04:45:35 devstack sudo[88733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:35 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-1885f0aa-fb3e-4a5e-88d2-c245789d823b tempest-VolumesDeleteCascade-906689606 None] Created reservations ['2f2b0812-e495-4177-96da-7af899a68df3', '33a9ae5c-2be9-4299-83ea-f62590f8643a', '2220df68-10cf-4c9d-a82f-5bab6283a863', 'c037b6c2-9e64-41c1-8557-bb2ceba9a35f'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:45:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-1885f0aa-fb3e-4a5e-88d2-c245789d823b tempest-VolumesDeleteCascade-906689606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-1885f0aa-fb3e-4a5e-88d2-c245789d823b tempest-VolumesDeleteCascade-906689606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:36 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-1885f0aa-fb3e-4a5e-88d2-c245789d823b tempest-VolumesDeleteCascade-906689606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:45:36 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-1885f0aa-fb3e-4a5e-88d2-c245789d823b tempest-VolumesDeleteCascade-906689606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:45:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-1885f0aa-fb3e-4a5e-88d2-c245789d823b tempest-VolumesDeleteCascade-906689606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1885f0aa-fb3e-4a5e-88d2-c245789d823b tempest-VolumesDeleteCascade-906689606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:36 devstack sudo[88734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c593bd40-dc03-40fc-8804-386d25ee2165
Feb 28 04:45:36 devstack sudo[88734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:36 devstack sudo[88737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:45:36 devstack sudo[88737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:36 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [req-a88749a0-15b3-4f27-8cd0-2bc3d48bf88f req-32f2a97f-4380-4b24-b69c-dfa7a6ac3ac7 tempest-VolumesGetTestJSON-390203849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:45:36 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-a88749a0-15b3-4f27-8cd0-2bc3d48bf88f req-32f2a97f-4380-4b24-b69c-dfa7a6ac3ac7 tempest-VolumesGetTestJSON-390203849 None] Flow 'volume_create_manager' (cf617d40-d498-4eb3-9a80-668be82a6517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:45:36 devstack sudo[88733]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:36 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-a88749a0-15b3-4f27-8cd0-2bc3d48bf88f req-32f2a97f-4380-4b24-b69c-dfa7a6ac3ac7 tempest-VolumesGetTestJSON-390203849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (405f7099-f425-4ae5-aaf0-06f2ac95c728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9646d63a-39ac-43f0-971d-85736e12597e tempest-VolumesActionsTest-4540298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1a5791b7-71df-4b03-b6aa-937fddc58da0" returned: 0 in 0.478s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:36 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-a88749a0-15b3-4f27-8cd0-2bc3d48bf88f req-32f2a97f-4380-4b24-b69c-dfa7a6ac3ac7 tempest-VolumesGetTestJSON-390203849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (405f7099-f425-4ae5-aaf0-06f2ac95c728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-584371063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a62317a6-ade5-4d4f-87f4-b1d5e98fe57a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='beeb3bab5f8446209d35639339819dcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:45:36Z,use_quota=True,user_id='b07d0e413dbc48d781604c598fc65ce1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:36 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-a88749a0-15b3-4f27-8cd0-2bc3d48bf88f req-32f2a97f-4380-4b24-b69c-dfa7a6ac3ac7 tempest-VolumesGetTestJSON-390203849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed44bedc-a4c8-42e9-b9af-cbeb5dafd28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:36 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-a88749a0-15b3-4f27-8cd0-2bc3d48bf88f req-32f2a97f-4380-4b24-b69c-dfa7a6ac3ac7 tempest-VolumesGetTestJSON-390203849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed44bedc-a4c8-42e9-b9af-cbeb5dafd28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:36 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-a88749a0-15b3-4f27-8cd0-2bc3d48bf88f req-32f2a97f-4380-4b24-b69c-dfa7a6ac3ac7 tempest-VolumesGetTestJSON-390203849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15f1f19b-49b0-447f-88fd-4907a096918e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:36 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-a88749a0-15b3-4f27-8cd0-2bc3d48bf88f req-32f2a97f-4380-4b24-b69c-dfa7a6ac3ac7 tempest-VolumesGetTestJSON-390203849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15f1f19b-49b0-447f-88fd-4907a096918e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a62317a6-ade5-4d4f-87f4-b1d5e98fe57a', 'volume_name': 'volume-a62317a6-ade5-4d4f-87f4-b1d5e98fe57a', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:36 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-a88749a0-15b3-4f27-8cd0-2bc3d48bf88f req-32f2a97f-4380-4b24-b69c-dfa7a6ac3ac7 tempest-VolumesGetTestJSON-390203849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fd8f4f5-402a-4150-bb84-0f7a460504f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:36 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-a88749a0-15b3-4f27-8cd0-2bc3d48bf88f req-32f2a97f-4380-4b24-b69c-dfa7a6ac3ac7 tempest-VolumesGetTestJSON-390203849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fd8f4f5-402a-4150-bb84-0f7a460504f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:36 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-a88749a0-15b3-4f27-8cd0-2bc3d48bf88f req-32f2a97f-4380-4b24-b69c-dfa7a6ac3ac7 tempest-VolumesGetTestJSON-390203849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecab3043-7a5e-445e-8166-0b7a7f5dadd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:36 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [req-a88749a0-15b3-4f27-8cd0-2bc3d48bf88f req-32f2a97f-4380-4b24-b69c-dfa7a6ac3ac7 tempest-VolumesGetTestJSON-390203849 None] Volume a62317a6-ade5-4d4f-87f4-b1d5e98fe57a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a62317a6-ade5-4d4f-87f4-b1d5e98fe57a', 'volume_size': 1}
Feb 28 04:45:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-a88749a0-15b3-4f27-8cd0-2bc3d48bf88f req-32f2a97f-4380-4b24-b69c-dfa7a6ac3ac7 tempest-VolumesGetTestJSON-390203849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-a88749a0-15b3-4f27-8cd0-2bc3d48bf88f req-32f2a97f-4380-4b24-b69c-dfa7a6ac3ac7 tempest-VolumesGetTestJSON-390203849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:36 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [req-a88749a0-15b3-4f27-8cd0-2bc3d48bf88f req-32f2a97f-4380-4b24-b69c-dfa7a6ac3ac7 tempest-VolumesGetTestJSON-390203849 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-584371063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a62317a6-ade5-4d4f-87f4-b1d5e98fe57a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='beeb3bab5f8446209d35639339819dcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:45:36Z,use_quota=True,user_id='b07d0e413dbc48d781604c598fc65ce1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:45:36 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [req-a88749a0-15b3-4f27-8cd0-2bc3d48bf88f req-32f2a97f-4380-4b24-b69c-dfa7a6ac3ac7 tempest-VolumesGetTestJSON-390203849 None] Creating volume a62317a6-ade5-4d4f-87f4-b1d5e98fe57a {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:45:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-a88749a0-15b3-4f27-8cd0-2bc3d48bf88f req-32f2a97f-4380-4b24-b69c-dfa7a6ac3ac7 tempest-VolumesGetTestJSON-390203849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-a88749a0-15b3-4f27-8cd0-2bc3d48bf88f req-32f2a97f-4380-4b24-b69c-dfa7a6ac3ac7 tempest-VolumesGetTestJSON-390203849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:36 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [req-a88749a0-15b3-4f27-8cd0-2bc3d48bf88f req-32f2a97f-4380-4b24-b69c-dfa7a6ac3ac7 tempest-VolumesGetTestJSON-390203849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:45:36 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [req-a88749a0-15b3-4f27-8cd0-2bc3d48bf88f req-32f2a97f-4380-4b24-b69c-dfa7a6ac3ac7 tempest-VolumesGetTestJSON-390203849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:45:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-a88749a0-15b3-4f27-8cd0-2bc3d48bf88f req-32f2a97f-4380-4b24-b69c-dfa7a6ac3ac7 tempest-VolumesGetTestJSON-390203849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:36 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [req-a88749a0-15b3-4f27-8cd0-2bc3d48bf88f req-32f2a97f-4380-4b24-b69c-dfa7a6ac3ac7 tempest-VolumesGetTestJSON-390203849 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:45:36 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [req-a88749a0-15b3-4f27-8cd0-2bc3d48bf88f req-32f2a97f-4380-4b24-b69c-dfa7a6ac3ac7 tempest-VolumesGetTestJSON-390203849 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:45:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-a88749a0-15b3-4f27-8cd0-2bc3d48bf88f req-32f2a97f-4380-4b24-b69c-dfa7a6ac3ac7 tempest-VolumesGetTestJSON-390203849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a62317a6-ade5-4d4f-87f4-b1d5e98fe57a 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:36 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-9646d63a-39ac-43f0-971d-85736e12597e tempest-VolumesActionsTest-4540298 None] Lock "cinder-quobyte-1a5791b7-71df-4b03-b6aa-937fddc58da0" released by "delete_volume" :: held 1.136s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:36 devstack sudo[88743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a62317a6-ade5-4d4f-87f4-b1d5e98fe57a 1073741824
Feb 28 04:45:36 devstack sudo[88743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:36 devstack sudo[88734]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-65feaf90-dcbe-42a4-9a49-1833d8862734 tempest-VolumesGetTest-507974651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c593bd40-dc03-40fc-8804-386d25ee2165" returned: 0 in 0.536s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-65feaf90-dcbe-42a4-9a49-1833d8862734 tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c593bd40-dc03-40fc-8804-386d25ee2165 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:36 devstack sudo[88745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c593bd40-dc03-40fc-8804-386d25ee2165
Feb 28 04:45:36 devstack sudo[88745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:36 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-9646d63a-39ac-43f0-971d-85736e12597e tempest-VolumesActionsTest-4540298 None] Created reservations ['bec68eb7-7acb-4f48-9ae3-a4e4f86c0d9f', '08f901c4-7d9d-4728-adc1-24096082b124', '83d38633-b512-450a-a3d0-dbaa015c4c10', 'fa053095-fd62-4617-ac55-3a0f01392767'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:45:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-9646d63a-39ac-43f0-971d-85736e12597e tempest-VolumesActionsTest-4540298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-9646d63a-39ac-43f0-971d-85736e12597e tempest-VolumesActionsTest-4540298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:36 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-9646d63a-39ac-43f0-971d-85736e12597e tempest-VolumesActionsTest-4540298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:45:36 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-9646d63a-39ac-43f0-971d-85736e12597e tempest-VolumesActionsTest-4540298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:45:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-9646d63a-39ac-43f0-971d-85736e12597e tempest-VolumesActionsTest-4540298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9646d63a-39ac-43f0-971d-85736e12597e tempest-VolumesActionsTest-4540298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:36 devstack sudo[88748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:45:36 devstack sudo[88748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:36 devstack sudo[88737]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1885f0aa-fb3e-4a5e-88d2-c245789d823b tempest-VolumesDeleteCascade-906689606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.571s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:36 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-1885f0aa-fb3e-4a5e-88d2-c245789d823b tempest-VolumesDeleteCascade-906689606 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:45:36 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-1885f0aa-fb3e-4a5e-88d2-c245789d823b tempest-VolumesDeleteCascade-906689606 None] Deleted volume successfully.
Feb 28 04:45:36 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1885f0aa-fb3e-4a5e-88d2-c245789d823b tempest-VolumesDeleteCascade-906689606 None] Lock "cinder-6e375fcc-0f47-43a2-a414-9a0cfc9d6d75-delete_volume" released by "delete_volume" :: held 1.891s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:36 devstack sudo[88745]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-65feaf90-dcbe-42a4-9a49-1833d8862734 tempest-VolumesGetTest-507974651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c593bd40-dc03-40fc-8804-386d25ee2165" returned: 0 in 0.438s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:36 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-65feaf90-dcbe-42a4-9a49-1833d8862734 tempest-VolumesGetTest-507974651 None] Lock "cinder-quobyte-c593bd40-dc03-40fc-8804-386d25ee2165" released by "delete_volume" :: held 1.013s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:36 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-65feaf90-dcbe-42a4-9a49-1833d8862734 tempest-VolumesGetTest-507974651 None] Created reservations ['d2eaa8f2-b814-42fe-b3c7-c35b25cc0554', '38837a49-2542-4e95-a240-8ecc17b78a3c', '4e7e4a8b-e4b5-4f6a-9bb4-c87dfdd096fd', 'dc1f195d-e358-4c69-9a8e-bd5de752b191'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:45:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-65feaf90-dcbe-42a4-9a49-1833d8862734 tempest-VolumesGetTest-507974651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-65feaf90-dcbe-42a4-9a49-1833d8862734 tempest-VolumesGetTest-507974651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:37 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-65feaf90-dcbe-42a4-9a49-1833d8862734 tempest-VolumesGetTest-507974651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:45:37 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-65feaf90-dcbe-42a4-9a49-1833d8862734 tempest-VolumesGetTest-507974651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:45:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-65feaf90-dcbe-42a4-9a49-1833d8862734 tempest-VolumesGetTest-507974651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-65feaf90-dcbe-42a4-9a49-1833d8862734 tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:37 devstack sudo[88743]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-a88749a0-15b3-4f27-8cd0-2bc3d48bf88f req-32f2a97f-4380-4b24-b69c-dfa7a6ac3ac7 tempest-VolumesGetTestJSON-390203849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a62317a6-ade5-4d4f-87f4-b1d5e98fe57a 1073741824" returned: 0 in 0.580s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:37 devstack sudo[88748]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:37 devstack sudo[88755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:45:37 devstack sudo[88755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9646d63a-39ac-43f0-971d-85736e12597e tempest-VolumesActionsTest-4540298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.497s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:37 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-9646d63a-39ac-43f0-971d-85736e12597e tempest-VolumesActionsTest-4540298 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:45:37 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-9646d63a-39ac-43f0-971d-85736e12597e tempest-VolumesActionsTest-4540298 None] Deleted volume successfully.
Feb 28 04:45:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-a88749a0-15b3-4f27-8cd0-2bc3d48bf88f req-32f2a97f-4380-4b24-b69c-dfa7a6ac3ac7 tempest-VolumesGetTestJSON-390203849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a62317a6-ade5-4d4f-87f4-b1d5e98fe57a {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:37 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-9646d63a-39ac-43f0-971d-85736e12597e tempest-VolumesActionsTest-4540298 None] Lock "cinder-1a5791b7-71df-4b03-b6aa-937fddc58da0-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:37 devstack sudo[88757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a62317a6-ade5-4d4f-87f4-b1d5e98fe57a
Feb 28 04:45:37 devstack sudo[88757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:37 devstack sudo[88755]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-65feaf90-dcbe-42a4-9a49-1833d8862734 tempest-VolumesGetTest-507974651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.420s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:37 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-65feaf90-dcbe-42a4-9a49-1833d8862734 tempest-VolumesGetTest-507974651 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:45:37 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-65feaf90-dcbe-42a4-9a49-1833d8862734 tempest-VolumesGetTest-507974651 None] Deleted volume successfully.
Feb 28 04:45:37 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-65feaf90-dcbe-42a4-9a49-1833d8862734 tempest-VolumesGetTest-507974651 None] Lock "cinder-c593bd40-dc03-40fc-8804-386d25ee2165-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:37 devstack sudo[88757]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-a88749a0-15b3-4f27-8cd0-2bc3d48bf88f req-32f2a97f-4380-4b24-b69c-dfa7a6ac3ac7 tempest-VolumesGetTestJSON-390203849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a62317a6-ade5-4d4f-87f4-b1d5e98fe57a" returned: 0 in 0.493s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:37 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [req-a88749a0-15b3-4f27-8cd0-2bc3d48bf88f req-32f2a97f-4380-4b24-b69c-dfa7a6ac3ac7 tempest-VolumesGetTestJSON-390203849 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:45:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-a88749a0-15b3-4f27-8cd0-2bc3d48bf88f req-32f2a97f-4380-4b24-b69c-dfa7a6ac3ac7 tempest-VolumesGetTestJSON-390203849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:37 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-a88749a0-15b3-4f27-8cd0-2bc3d48bf88f req-32f2a97f-4380-4b24-b69c-dfa7a6ac3ac7 tempest-VolumesGetTestJSON-390203849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecab3043-7a5e-445e-8166-0b7a7f5dadd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a62317a6-ade5-4d4f-87f4-b1d5e98fe57a', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:37 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-a88749a0-15b3-4f27-8cd0-2bc3d48bf88f req-32f2a97f-4380-4b24-b69c-dfa7a6ac3ac7 tempest-VolumesGetTestJSON-390203849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6425baa-c960-493f-be97-fee3041d8406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:37 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [req-a88749a0-15b3-4f27-8cd0-2bc3d48bf88f req-32f2a97f-4380-4b24-b69c-dfa7a6ac3ac7 tempest-VolumesGetTestJSON-390203849 None] Volume volume-a62317a6-ade5-4d4f-87f4-b1d5e98fe57a (a62317a6-ade5-4d4f-87f4-b1d5e98fe57a): created successfully
Feb 28 04:45:37 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-a88749a0-15b3-4f27-8cd0-2bc3d48bf88f req-32f2a97f-4380-4b24-b69c-dfa7a6ac3ac7 tempest-VolumesGetTestJSON-390203849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6425baa-c960-493f-be97-fee3041d8406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:37 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [req-a88749a0-15b3-4f27-8cd0-2bc3d48bf88f req-32f2a97f-4380-4b24-b69c-dfa7a6ac3ac7 tempest-VolumesGetTestJSON-390203849 None] Flow 'volume_create_manager' (cf617d40-d498-4eb3-9a80-668be82a6517) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:45:37 devstack cinder-volume[84248]: INFO cinder.volume.manager [req-a88749a0-15b3-4f27-8cd0-2bc3d48bf88f req-32f2a97f-4380-4b24-b69c-dfa7a6ac3ac7 tempest-VolumesGetTestJSON-390203849 None] Created volume successfully.
Feb 28 04:45:38 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-73a22aca-62a5-45c6-9350-7dead0866366 tempest-VolumesGetTest-507974651 None] Acquiring lock "cinder-d263cf60-5c16-4b44-978f-64cadcd017ec-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:38 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-73a22aca-62a5-45c6-9350-7dead0866366 tempest-VolumesGetTest-507974651 None] Lock "cinder-d263cf60-5c16-4b44-978f-64cadcd017ec-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:38 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-73a22aca-62a5-45c6-9350-7dead0866366 tempest-VolumesGetTest-507974651 None] Acquiring lock "cinder-quobyte-d263cf60-5c16-4b44-978f-64cadcd017ec" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:38 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-73a22aca-62a5-45c6-9350-7dead0866366 tempest-VolumesGetTest-507974651 None] Lock "cinder-quobyte-d263cf60-5c16-4b44-978f-64cadcd017ec" acquired by "delete_volume" :: waited 0.012s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:38 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[af44eaf6-feee-4f8c-b4ea-c235c405456c]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-73a22aca-62a5-45c6-9350-7dead0866366 tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-d263cf60-5c16-4b44-978f-64cadcd017ec {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:38 devstack sudo[88762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-d263cf60-5c16-4b44-978f-64cadcd017ec
Feb 28 04:45:38 devstack sudo[88762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:38 devstack sudo[88762]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-73a22aca-62a5-45c6-9350-7dead0866366 tempest-VolumesGetTest-507974651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-d263cf60-5c16-4b44-978f-64cadcd017ec" returned: 0 in 0.632s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-73a22aca-62a5-45c6-9350-7dead0866366 tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-d263cf60-5c16-4b44-978f-64cadcd017ec {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:38 devstack cinder-volume[84248]: DEBUG cinder.coordination [req-c8c82590-0651-41b9-a44a-afc1d1e0eef9 req-7c632ab3-b711-4ae2-a841-23bfef803b94 tempest-VolumesGetTestJSON-390203849 None] Acquiring lock "cinder-a62317a6-ade5-4d4f-87f4-b1d5e98fe57a-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:38 devstack cinder-volume[84248]: DEBUG cinder.coordination [req-c8c82590-0651-41b9-a44a-afc1d1e0eef9 req-7c632ab3-b711-4ae2-a841-23bfef803b94 tempest-VolumesGetTestJSON-390203849 None] Lock "cinder-a62317a6-ade5-4d4f-87f4-b1d5e98fe57a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:38 devstack sudo[88768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-d263cf60-5c16-4b44-978f-64cadcd017ec
Feb 28 04:45:38 devstack sudo[88768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:38 devstack cinder-volume[84248]: DEBUG cinder.coordination [req-c8c82590-0651-41b9-a44a-afc1d1e0eef9 req-7c632ab3-b711-4ae2-a841-23bfef803b94 tempest-VolumesGetTestJSON-390203849 None] Acquiring lock "cinder-quobyte-a62317a6-ade5-4d4f-87f4-b1d5e98fe57a" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:38 devstack cinder-volume[84248]: DEBUG cinder.coordination [req-c8c82590-0651-41b9-a44a-afc1d1e0eef9 req-7c632ab3-b711-4ae2-a841-23bfef803b94 tempest-VolumesGetTestJSON-390203849 None] Lock "cinder-quobyte-a62317a6-ade5-4d4f-87f4-b1d5e98fe57a" acquired by "delete_volume" :: waited 0.010s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:38 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[c123a9ed-f093-4f42-b490-a0a1fc1ea4c9]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-c8c82590-0651-41b9-a44a-afc1d1e0eef9 req-7c632ab3-b711-4ae2-a841-23bfef803b94 tempest-VolumesGetTestJSON-390203849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a62317a6-ade5-4d4f-87f4-b1d5e98fe57a {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:39 devstack sudo[88770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a62317a6-ade5-4d4f-87f4-b1d5e98fe57a
Feb 28 04:45:39 devstack sudo[88770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:39 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:45:39 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Flow 'volume_create_manager' (0cde0d2c-b033-479a-af37-1a3edd883fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:45:39 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5e26d37-41d5-4df6-9561-1d94e2871ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:39 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5e26d37-41d5-4df6-9561-1d94e2871ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1480592169',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0daf79b5-85d1-4f68-af32-9c0c699d4d52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e377809876f4437e8cccf021ae48e17a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:45:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:45:39Z,use_quota=True,user_id='44d6aa40c25d4ceeb26300836607fd5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:39 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed9b93ad-4070-49b1-a2ce-d82fdd3b0611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:39 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed9b93ad-4070-49b1-a2ce-d82fdd3b0611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:39 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35341a66-3f2c-4480-8a42-359140a3c131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:39 devstack cinder-volume[84248]: DEBUG cinder.image.glance [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Creating Keystone auth plugin from conf {{(pid=84248) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Feb 28 04:45:39 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35341a66-3f2c-4480-8a42-359140a3c131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0daf79b5-85d1-4f68-af32-9c0c699d4d52', 'volume_name': 'volume-0daf79b5-85d1-4f68-af32-9c0c699d4d52', 'volume_size': 1, 'image_id': '2c3eb214-ef72-4569-9890-199b020755f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2c3eb214-ef72-4569-9890-199b020755f9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c0fde1a75874ab3961d0c965899b1f4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2c3eb214-ef72-4569-9890-199b020755f9', 'created_at': datetime.datetime(2026, 2, 28, 3, 36, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 28, 3, 36, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2c3eb214-ef72-4569-9890-199b020755f9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5e40230430>}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:39 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f644780-b33d-4829-9096-112473bb4106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:39 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f644780-b33d-4829-9096-112473bb4106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:39 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba7a2062-8838-4399-9b92-6666e397dbf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:39 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Volume 0daf79b5-85d1-4f68-af32-9c0c699d4d52: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0daf79b5-85d1-4f68-af32-9c0c699d4d52', 'volume_size': 1, 'image_id': '2c3eb214-ef72-4569-9890-199b020755f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2c3eb214-ef72-4569-9890-199b020755f9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c0fde1a75874ab3961d0c965899b1f4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2c3eb214-ef72-4569-9890-199b020755f9', 'created_at': datetime.datetime(2026, 2, 28, 3, 36, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 28, 3, 36, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2c3eb214-ef72-4569-9890-199b020755f9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5e40230430>}
Feb 28 04:45:39 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Trying to clone 0daf79b5-85d1-4f68-af32-9c0c699d4d52 from image 2c3eb214-ef72-4569-9890-199b020755f9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2c3eb214-ef72-4569-9890-199b020755f9', 'metadata': {}}]). {{(pid=84248) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Feb 28 04:45:39 devstack sudo[88768]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-73a22aca-62a5-45c6-9350-7dead0866366 tempest-VolumesGetTest-507974651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-d263cf60-5c16-4b44-978f-64cadcd017ec" returned: 0 in 0.544s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:39 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-73a22aca-62a5-45c6-9350-7dead0866366 tempest-VolumesGetTest-507974651 None] Lock "cinder-quobyte-d263cf60-5c16-4b44-978f-64cadcd017ec" released by "delete_volume" :: held 1.208s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:39 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-73a22aca-62a5-45c6-9350-7dead0866366 tempest-VolumesGetTest-507974651 None] Created reservations ['2b87f8cb-da95-46b3-b11d-2f72eb864b66', 'b4f15ac4-3604-493c-97e8-9d467986e8f2', 'b237a7ad-0d26-4043-82f7-c4d44944ef53', '89bb2c1f-aa2c-4ee6-aec5-66ddc70f8aaa'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:45:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-73a22aca-62a5-45c6-9350-7dead0866366 tempest-VolumesGetTest-507974651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-73a22aca-62a5-45c6-9350-7dead0866366 tempest-VolumesGetTest-507974651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:39 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-73a22aca-62a5-45c6-9350-7dead0866366 tempest-VolumesGetTest-507974651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:45:39 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-73a22aca-62a5-45c6-9350-7dead0866366 tempest-VolumesGetTest-507974651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:45:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-73a22aca-62a5-45c6-9350-7dead0866366 tempest-VolumesGetTest-507974651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-73a22aca-62a5-45c6-9350-7dead0866366 tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:39 devstack sudo[88777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:45:39 devstack sudo[88777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:39 devstack sudo[88770]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-c8c82590-0651-41b9-a44a-afc1d1e0eef9 req-7c632ab3-b711-4ae2-a841-23bfef803b94 tempest-VolumesGetTestJSON-390203849 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a62317a6-ade5-4d4f-87f4-b1d5e98fe57a" returned: 0 in 0.640s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-c8c82590-0651-41b9-a44a-afc1d1e0eef9 req-7c632ab3-b711-4ae2-a841-23bfef803b94 tempest-VolumesGetTestJSON-390203849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a62317a6-ade5-4d4f-87f4-b1d5e98fe57a {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:39 devstack sudo[88779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a62317a6-ade5-4d4f-87f4-b1d5e98fe57a
Feb 28 04:45:39 devstack sudo[88779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:39 devstack cinder-volume[84248]: DEBUG cinder.image.image_utils [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_qfpt0kpzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84248) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Feb 28 04:45:39 devstack cinder-volume[84248]: INFO cinder.image.image_utils [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Image download 20.69 MB at 20.69 MB/s
Feb 28 04:45:39 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f02c099-6ea1-4649-95bf-47629a1a4d13]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_qfpt0kpzdevstack@QuobyteHD {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:39 devstack sudo[88781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_qfpt0kpzdevstack@QuobyteHD
Feb 28 04:45:39 devstack sudo[88781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:40 devstack sudo[88779]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-c8c82590-0651-41b9-a44a-afc1d1e0eef9 req-7c632ab3-b711-4ae2-a841-23bfef803b94 tempest-VolumesGetTestJSON-390203849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a62317a6-ade5-4d4f-87f4-b1d5e98fe57a" returned: 0 in 0.481s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:40 devstack cinder-volume[84248]: DEBUG cinder.coordination [req-c8c82590-0651-41b9-a44a-afc1d1e0eef9 req-7c632ab3-b711-4ae2-a841-23bfef803b94 tempest-VolumesGetTestJSON-390203849 None] Lock "cinder-quobyte-a62317a6-ade5-4d4f-87f4-b1d5e98fe57a" released by "delete_volume" :: held 1.156s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:40 devstack sudo[88777]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:40 devstack cinder-volume[84248]: DEBUG cinder.quota [req-c8c82590-0651-41b9-a44a-afc1d1e0eef9 req-7c632ab3-b711-4ae2-a841-23bfef803b94 tempest-VolumesGetTestJSON-390203849 None] Created reservations ['0e39ee1f-5766-4473-a910-f29d92bee8fb', 'ef381d70-c9c8-4f63-8da6-853f9e8573c1', '1b4ad247-e4d6-4835-9f9f-a706601cafac', '9140f52d-56c2-4d82-991e-6422ebe1c5c9'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:45:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-73a22aca-62a5-45c6-9350-7dead0866366 tempest-VolumesGetTest-507974651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.581s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:40 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-73a22aca-62a5-45c6-9350-7dead0866366 tempest-VolumesGetTest-507974651 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:45:40 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-73a22aca-62a5-45c6-9350-7dead0866366 tempest-VolumesGetTest-507974651 None] Deleted volume successfully.
Feb 28 04:45:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-c8c82590-0651-41b9-a44a-afc1d1e0eef9 req-7c632ab3-b711-4ae2-a841-23bfef803b94 tempest-VolumesGetTestJSON-390203849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-c8c82590-0651-41b9-a44a-afc1d1e0eef9 req-7c632ab3-b711-4ae2-a841-23bfef803b94 tempest-VolumesGetTestJSON-390203849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:40 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [req-c8c82590-0651-41b9-a44a-afc1d1e0eef9 req-7c632ab3-b711-4ae2-a841-23bfef803b94 tempest-VolumesGetTestJSON-390203849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:45:40 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [req-c8c82590-0651-41b9-a44a-afc1d1e0eef9 req-7c632ab3-b711-4ae2-a841-23bfef803b94 tempest-VolumesGetTestJSON-390203849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:45:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [req-c8c82590-0651-41b9-a44a-afc1d1e0eef9 req-7c632ab3-b711-4ae2-a841-23bfef803b94 tempest-VolumesGetTestJSON-390203849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-c8c82590-0651-41b9-a44a-afc1d1e0eef9 req-7c632ab3-b711-4ae2-a841-23bfef803b94 tempest-VolumesGetTestJSON-390203849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:40 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-73a22aca-62a5-45c6-9350-7dead0866366 tempest-VolumesGetTest-507974651 None] Lock "cinder-d263cf60-5c16-4b44-978f-64cadcd017ec-delete_volume" released by "delete_volume" :: held 2.026s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:40 devstack sudo[88789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:45:40 devstack sudo[88789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:40 devstack sudo[88781]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_qfpt0kpzdevstack@QuobyteHD" returned: 0 in 0.579s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:40 devstack cinder-volume[84248]: DEBUG cinder.image.image_utils [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Temporary image 2c3eb214-ef72-4569-9890-199b020755f9 is fetched for user 44d6aa40c25d4ceeb26300836607fd5b. {{(pid=84248) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Feb 28 04:45:40 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc5fafe-08a4-4e33-bda1-0d08518795a6]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_qfpt0kpzdevstack@QuobyteHD {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:40 devstack sudo[88792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_qfpt0kpzdevstack@QuobyteHD
Feb 28 04:45:40 devstack sudo[88792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:40 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab8e70f6-e84a-4891-809f-95e55ec7a335 tempest-VolumesGetTest-507974651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:45:40 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ab8e70f6-e84a-4891-809f-95e55ec7a335 tempest-VolumesGetTest-507974651 None] Flow 'volume_create_manager' (ce00209c-40ab-4745-9861-36128da3feea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:45:40 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ab8e70f6-e84a-4891-809f-95e55ec7a335 tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d2a8c14-9f80-440f-92d5-aa3ac1e9a44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:40 devstack sudo[88789]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:40 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ab8e70f6-e84a-4891-809f-95e55ec7a335 tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d2a8c14-9f80-440f-92d5-aa3ac1e9a44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1310268603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd6ced8f-e392-43d0-9111-db3a249fc4f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='992ba50d9e4a432fbe7b2db9bbd34498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:45:41Z,use_quota=True,user_id='2247d4e35589438db75df793320c521a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:40 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ab8e70f6-e84a-4891-809f-95e55ec7a335 tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c05a1d9-1520-44aa-bc3b-31d106541847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:40 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ab8e70f6-e84a-4891-809f-95e55ec7a335 tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c05a1d9-1520-44aa-bc3b-31d106541847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:40 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ab8e70f6-e84a-4891-809f-95e55ec7a335 tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01d70dd3-0bee-4076-b712-40aed11f8d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:40 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ab8e70f6-e84a-4891-809f-95e55ec7a335 tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01d70dd3-0bee-4076-b712-40aed11f8d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd6ced8f-e392-43d0-9111-db3a249fc4f5', 'volume_name': 'volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:40 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ab8e70f6-e84a-4891-809f-95e55ec7a335 tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86929ec5-f1f0-4720-8ea2-e7ad57bb4851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:40 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ab8e70f6-e84a-4891-809f-95e55ec7a335 tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86929ec5-f1f0-4720-8ea2-e7ad57bb4851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:40 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ab8e70f6-e84a-4891-809f-95e55ec7a335 tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25bc7c9e-eff1-4fc4-96ac-9908bbe61697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:40 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-ab8e70f6-e84a-4891-809f-95e55ec7a335 tempest-VolumesGetTest-507974651 None] Volume bd6ced8f-e392-43d0-9111-db3a249fc4f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5', 'volume_size': 1}
Feb 28 04:45:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ab8e70f6-e84a-4891-809f-95e55ec7a335 tempest-VolumesGetTest-507974651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ab8e70f6-e84a-4891-809f-95e55ec7a335 tempest-VolumesGetTest-507974651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:40 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-ab8e70f6-e84a-4891-809f-95e55ec7a335 tempest-VolumesGetTest-507974651 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1310268603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd6ced8f-e392-43d0-9111-db3a249fc4f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='992ba50d9e4a432fbe7b2db9bbd34498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:45:41Z,use_quota=True,user_id='2247d4e35589438db75df793320c521a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:45:40 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-ab8e70f6-e84a-4891-809f-95e55ec7a335 tempest-VolumesGetTest-507974651 None] Creating volume bd6ced8f-e392-43d0-9111-db3a249fc4f5 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:45:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ab8e70f6-e84a-4891-809f-95e55ec7a335 tempest-VolumesGetTest-507974651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ab8e70f6-e84a-4891-809f-95e55ec7a335 tempest-VolumesGetTest-507974651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:40 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-ab8e70f6-e84a-4891-809f-95e55ec7a335 tempest-VolumesGetTest-507974651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:45:40 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-ab8e70f6-e84a-4891-809f-95e55ec7a335 tempest-VolumesGetTest-507974651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:45:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ab8e70f6-e84a-4891-809f-95e55ec7a335 tempest-VolumesGetTest-507974651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:40 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-ab8e70f6-e84a-4891-809f-95e55ec7a335 tempest-VolumesGetTest-507974651 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:45:40 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-ab8e70f6-e84a-4891-809f-95e55ec7a335 tempest-VolumesGetTest-507974651 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:45:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ab8e70f6-e84a-4891-809f-95e55ec7a335 tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [req-c8c82590-0651-41b9-a44a-afc1d1e0eef9 req-7c632ab3-b711-4ae2-a841-23bfef803b94 tempest-VolumesGetTestJSON-390203849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.516s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:40 devstack cinder-volume[84248]: DEBUG cinder.manager [req-c8c82590-0651-41b9-a44a-afc1d1e0eef9 req-7c632ab3-b711-4ae2-a841-23bfef803b94 tempest-VolumesGetTestJSON-390203849 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:45:40 devstack cinder-volume[84248]: INFO cinder.volume.manager [req-c8c82590-0651-41b9-a44a-afc1d1e0eef9 req-7c632ab3-b711-4ae2-a841-23bfef803b94 tempest-VolumesGetTestJSON-390203849 None] Deleted volume successfully.
Feb 28 04:45:40 devstack sudo[88795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5 1073741824
Feb 28 04:45:40 devstack sudo[88795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:40 devstack cinder-volume[84248]: DEBUG cinder.coordination [req-c8c82590-0651-41b9-a44a-afc1d1e0eef9 req-7c632ab3-b711-4ae2-a841-23bfef803b94 tempest-VolumesGetTestJSON-390203849 None] Lock "cinder-a62317a6-ade5-4d4f-87f4-b1d5e98fe57a-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:40 devstack sudo[88792]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_qfpt0kpzdevstack@QuobyteHD" returned: 0 in 0.557s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:41 devstack sudo[88795]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ab8e70f6-e84a-4891-809f-95e55ec7a335 tempest-VolumesGetTest-507974651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5 1073741824" returned: 0 in 0.560s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ab8e70f6-e84a-4891-809f-95e55ec7a335 tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:41 devstack sudo[88803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5
Feb 28 04:45:41 devstack sudo[88803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:41 devstack sudo[88803]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ab8e70f6-e84a-4891-809f-95e55ec7a335 tempest-VolumesGetTest-507974651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5" returned: 0 in 0.507s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:41 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-ab8e70f6-e84a-4891-809f-95e55ec7a335 tempest-VolumesGetTest-507974651 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:45:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ab8e70f6-e84a-4891-809f-95e55ec7a335 tempest-VolumesGetTest-507974651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.890s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:41 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1480592169',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0daf79b5-85d1-4f68-af32-9c0c699d4d52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e377809876f4437e8cccf021ae48e17a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:45:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:45:39Z,use_quota=True,user_id='44d6aa40c25d4ceeb26300836607fd5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:45:41 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Creating volume 0daf79b5-85d1-4f68-af32-9c0c699d4d52 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:45:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:41 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:45:41 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:45:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:41 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:45:41 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:45:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0daf79b5-85d1-4f68-af32-9c0c699d4d52 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:41 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ab8e70f6-e84a-4891-809f-95e55ec7a335 tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25bc7c9e-eff1-4fc4-96ac-9908bbe61697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:41 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ab8e70f6-e84a-4891-809f-95e55ec7a335 tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b8bef5e-43d0-4775-abef-79fbea06f68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:41 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-ab8e70f6-e84a-4891-809f-95e55ec7a335 tempest-VolumesGetTest-507974651 None] Volume volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5 (bd6ced8f-e392-43d0-9111-db3a249fc4f5): created successfully
Feb 28 04:45:41 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ab8e70f6-e84a-4891-809f-95e55ec7a335 tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b8bef5e-43d0-4775-abef-79fbea06f68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:41 devstack sudo[88807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0daf79b5-85d1-4f68-af32-9c0c699d4d52 1073741824
Feb 28 04:45:41 devstack sudo[88807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:41 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ab8e70f6-e84a-4891-809f-95e55ec7a335 tempest-VolumesGetTest-507974651 None] Flow 'volume_create_manager' (ce00209c-40ab-4745-9861-36128da3feea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:45:41 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-ab8e70f6-e84a-4891-809f-95e55ec7a335 tempest-VolumesGetTest-507974651 None] Created volume successfully.
Feb 28 04:45:42 devstack sudo[88807]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:42 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0daf79b5-85d1-4f68-af32-9c0c699d4d52 1073741824" returned: 0 in 0.542s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:42 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0daf79b5-85d1-4f68-af32-9c0c699d4d52 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:42 devstack sudo[88812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0daf79b5-85d1-4f68-af32-9c0c699d4d52
Feb 28 04:45:42 devstack sudo[88812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:42 devstack sudo[88812]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:42 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0daf79b5-85d1-4f68-af32-9c0c699d4d52" returned: 0 in 0.591s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:42 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:45:42 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:42 devstack cinder-volume[84248]: DEBUG cinder.volume.volume_utils [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Attempting download of 2c3eb214-ef72-4569-9890-199b020755f9 ((None, [{'url': 'file:///opt/stack/data/glance/images/2c3eb214-ef72-4569-9890-199b020755f9', 'metadata': {}}])) to volume 0daf79b5-85d1-4f68-af32-9c0c699d4d52. {{(pid=84248) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Feb 28 04:45:43 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[7364eef3-8147-4d1a-8572-95435cf562a6]: (4, 'raw') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:43 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2c3eb214-ef72-4569-9890-199b020755f9_lkdwowsa {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:43 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:45:43 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Flow 'volume_create_manager' (dbfd36ef-c001-4de5-8d9c-029f340fba53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:45:43 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0cab3d5-7748-42a9-83c0-5882fa6a3d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:43 devstack sudo[88816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2c3eb214-ef72-4569-9890-199b020755f9_lkdwowsa
Feb 28 04:45:43 devstack sudo[88816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:43 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0cab3d5-7748-42a9-83c0-5882fa6a3d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-482669783',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=744e33ca-6729-4487-afc1-79fbd1f43005,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='992ba50d9e4a432fbe7b2db9bbd34498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=bd6ced8f-e392-43d0-9111-db3a249fc4f5,status='creating',terminated_at=None,updated_at=2026-02-28T03:45:43Z,use_quota=True,user_id='2247d4e35589438db75df793320c521a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:43 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4f5c68c-0b99-446b-923f-2c8427a08602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:43 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4f5c68c-0b99-446b-923f-2c8427a08602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:43 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8be11645-e636-41aa-9f51-0635b5f3cd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:43 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8be11645-e636-41aa-9f51-0635b5f3cd4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '744e33ca-6729-4487-afc1-79fbd1f43005', 'volume_name': 'volume-744e33ca-6729-4487-afc1-79fbd1f43005', 'volume_size': 1, 'source_volid': 'bd6ced8f-e392-43d0-9111-db3a249fc4f5', 'source_volstatus': 'available'}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:43 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b95895a-b767-40c6-b23e-40ce882528a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:43 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b95895a-b767-40c6-b23e-40ce882528a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:43 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11636cd9-bb06-4c37-8ad7-0163c4a8b9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:43 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Volume 744e33ca-6729-4487-afc1-79fbd1f43005: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-744e33ca-6729-4487-afc1-79fbd1f43005', 'volume_size': 1, 'source_volid': 'bd6ced8f-e392-43d0-9111-db3a249fc4f5', 'source_volstatus': 'available'}
Feb 28 04:45:43 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:43 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:43 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Cloning volume bd6ced8f-e392-43d0-9111-db3a249fc4f5 to volume 744e33ca-6729-4487-afc1-79fbd1f43005
Feb 28 04:45:43 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Creating offline snapshot 1b6d656e-8e78-4120-8727-ed96a892f713 of volume bd6ced8f-e392-43d0-9111-db3a249fc4f5 {{(pid=84248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 04:45:43 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de58ca4-a59e-4aa2-a95f-2e245818a94e]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:43 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:43 devstack sudo[88818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5
Feb 28 04:45:43 devstack sudo[88818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:43 devstack sudo[88816]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:43 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2c3eb214-ef72-4569-9890-199b020755f9_lkdwowsa" returned: 0 in 0.658s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:43 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c3eb214-ef72-4569-9890-199b020755f9_lkdwowsa {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:43 devstack sudo[88822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c3eb214-ef72-4569-9890-199b020755f9_lkdwowsa
Feb 28 04:45:43 devstack sudo[88822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:43 devstack sudo[88818]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:43 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5" returned: 0 in 0.630s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:43 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5.1b6d656e-8e78-4120-8727-ed96a892f713 1G {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:43 devstack sudo[88827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5.1b6d656e-8e78-4120-8727-ed96a892f713 1G
Feb 28 04:45:43 devstack sudo[88827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:44 devstack sudo[88822]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c3eb214-ef72-4569-9890-199b020755f9_lkdwowsa" returned: 1 in 0.533s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c3eb214-ef72-4569-9890-199b020755f9_lkdwowsa' failed. Not Retrying. {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 28 04:45:44 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d16aaf-e325-4e5b-82b8-2184f461ab9e]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_qfpt0kpzdevstack@QuobyteHD {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:44 devstack sudo[88831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_qfpt0kpzdevstack@QuobyteHD
Feb 28 04:45:44 devstack sudo[88831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:44 devstack sudo[88827]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5.1b6d656e-8e78-4120-8727-ed96a892f713 1G" returned: 0 in 0.542s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5.1b6d656e-8e78-4120-8727-ed96a892f713 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:44 devstack sudo[88836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5.1b6d656e-8e78-4120-8727-ed96a892f713
Feb 28 04:45:44 devstack sudo[88836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:44 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-0166e0b5-0eae-4b72-8a3d-b03942f66cf8 tempest-BackendsCapabilitiesAdminTestsJSON-763201452 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580757141113, 'free_capacity_gb': 1775.7580757141113, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84248) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Feb 28 04:45:44 devstack sudo[88831]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_qfpt0kpzdevstack@QuobyteHD" returned: 0 in 0.507s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:44 devstack cinder-volume[84248]: DEBUG cinder.image.image_utils [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] 2c3eb214-ef72-4569-9890-199b020755f9 was qcow2, converting to raw {{(pid=84248) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Feb 28 04:45:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_qfpt0kpzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0daf79b5-85d1-4f68-af32-9c0c699d4d52 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:44 devstack sudo[88842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_qfpt0kpzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0daf79b5-85d1-4f68-af32-9c0c699d4d52
Feb 28 04:45:44 devstack sudo[88842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:44 devstack sudo[88836]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5.1b6d656e-8e78-4120-8727-ed96a892f713" returned: 0 in 0.475s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:44 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5.1b6d656e-8e78-4120-8727-ed96a892f713 is being set with open permissions: ugo+rw
Feb 28 04:45:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5.1b6d656e-8e78-4120-8727-ed96a892f713 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:44 devstack sudo[88847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5.1b6d656e-8e78-4120-8727-ed96a892f713
Feb 28 04:45:44 devstack sudo[88847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:45 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-381f9dae-4a66-42b6-8406-f73f18e5ce85 tempest-BackendsCapabilitiesAdminTestsJSON-763201452 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580757141113, 'free_capacity_gb': 1775.7580757141113, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84248) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Feb 28 04:45:45 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:45:45 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Flow 'volume_create_manager' (264c3856-57ff-4bed-9183-2e383a99a03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:45:45 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0872bd2f-f98d-4be0-8e8b-e3658fc3e8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:45 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0872bd2f-f98d-4be0-8e8b-e3658fc3e8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-243185223',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ff513bc-4bc3-43f5-96da-af4908a5c7ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffa5b3079f3d44ca94e4307cea1cffe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:45:45Z,use_quota=True,user_id='cf4aa8f4cb1d451c8c3b3fa1dc9ac3d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:45 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12e75e48-e371-4244-a50a-207353e2596e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:45 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12e75e48-e371-4244-a50a-207353e2596e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:45 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (788888c7-7614-4a6c-a80f-e37710caad9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:45 devstack cinder-volume[84248]: DEBUG cinder.image.glance [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Creating Keystone auth plugin from conf {{(pid=84248) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Feb 28 04:45:45 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (788888c7-7614-4a6c-a80f-e37710caad9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6ff513bc-4bc3-43f5-96da-af4908a5c7ca', 'volume_name': 'volume-6ff513bc-4bc3-43f5-96da-af4908a5c7ca', 'volume_size': 1, 'image_id': '2c3eb214-ef72-4569-9890-199b020755f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2c3eb214-ef72-4569-9890-199b020755f9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c0fde1a75874ab3961d0c965899b1f4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2c3eb214-ef72-4569-9890-199b020755f9', 'created_at': datetime.datetime(2026, 2, 28, 3, 36, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 28, 3, 36, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2c3eb214-ef72-4569-9890-199b020755f9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5e40256b90>}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:45 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d79c4c5-5a5a-4b9e-a5d2-c417b58083b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:45 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d79c4c5-5a5a-4b9e-a5d2-c417b58083b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:45 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9c82d98-6024-4f30-b1da-690b48b38570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:45 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Volume 6ff513bc-4bc3-43f5-96da-af4908a5c7ca: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6ff513bc-4bc3-43f5-96da-af4908a5c7ca', 'volume_size': 1, 'image_id': '2c3eb214-ef72-4569-9890-199b020755f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2c3eb214-ef72-4569-9890-199b020755f9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c0fde1a75874ab3961d0c965899b1f4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2c3eb214-ef72-4569-9890-199b020755f9', 'created_at': datetime.datetime(2026, 2, 28, 3, 36, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 28, 3, 36, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2c3eb214-ef72-4569-9890-199b020755f9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5e40256b90>}
Feb 28 04:45:45 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Trying to clone 6ff513bc-4bc3-43f5-96da-af4908a5c7ca from image 2c3eb214-ef72-4569-9890-199b020755f9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2c3eb214-ef72-4569-9890-199b020755f9', 'metadata': {}}]). {{(pid=84248) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Feb 28 04:45:45 devstack sudo[88847]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5.1b6d656e-8e78-4120-8727-ed96a892f713" returned: 0 in 0.589s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:45 devstack sudo[88863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5.info
Feb 28 04:45:45 devstack sudo[88863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:45 devstack cinder-volume[84248]: DEBUG cinder.image.image_utils [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_24yifnlxdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84248) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Feb 28 04:45:45 devstack cinder-volume[84248]: INFO cinder.image.image_utils [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Image download 20.69 MB at 20.69 MB/s
Feb 28 04:45:45 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[db774b84-f8b4-4e39-8df6-937fd4c69b45]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_24yifnlxdevstack@QuobyteHD {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:45 devstack sudo[88866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_24yifnlxdevstack@QuobyteHD
Feb 28 04:45:45 devstack sudo[88866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:45 devstack sudo[88842]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_qfpt0kpzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0daf79b5-85d1-4f68-af32-9c0c699d4d52" returned: 0 in 1.034s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:45 devstack cinder-volume[84248]: DEBUG cinder.image.image_utils [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_qfpt0kpzdevstack@QuobyteHD, size 112.00 MB, duration 1.04 sec, destination /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0daf79b5-85d1-4f68-af32-9c0c699d4d52 {{(pid=84248) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 28 04:45:45 devstack cinder-volume[84248]: INFO cinder.image.image_utils [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Converted 112.00 MB image at 108.17 MB/s
Feb 28 04:45:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0daf79b5-85d1-4f68-af32-9c0c699d4d52 1G {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:45 devstack sudo[88868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0daf79b5-85d1-4f68-af32-9c0c699d4d52 1G
Feb 28 04:45:45 devstack sudo[88868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:46 devstack sudo[88863]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:46 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5.info" returned: 0 in 0.545s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:46 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5.info is being set with open permissions: ugo+rw
Feb 28 04:45:46 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:46 devstack sudo[88871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5.info
Feb 28 04:45:46 devstack sudo[88871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:46 devstack sudo[88866]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:46 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_24yifnlxdevstack@QuobyteHD" returned: 0 in 0.550s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:46 devstack cinder-volume[84248]: DEBUG cinder.image.image_utils [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Temporary image 2c3eb214-ef72-4569-9890-199b020755f9 is fetched for user cf4aa8f4cb1d451c8c3b3fa1dc9ac3d4. {{(pid=84248) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Feb 28 04:45:46 devstack sudo[88868]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:46 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c81540-85fb-40d3-8d5f-8b8699f07c73]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:46 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_24yifnlxdevstack@QuobyteHD {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:46 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0daf79b5-85d1-4f68-af32-9c0c699d4d52 1G" returned: 0 in 0.540s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:46 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bde5ae-4623-403a-8ab0-83c18210d518]: (4, 'raw') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:46 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0daf79b5-85d1-4f68-af32-9c0c699d4d52 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:46 devstack sudo[88879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_24yifnlxdevstack@QuobyteHD
Feb 28 04:45:46 devstack sudo[88879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:46 devstack sudo[88880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0daf79b5-85d1-4f68-af32-9c0c699d4d52
Feb 28 04:45:46 devstack sudo[88880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:46 devstack sudo[88871]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:46 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5.info" returned: 0 in 0.497s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:46 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Acquiring lock "cinder-quobyte-744e33ca-6729-4487-afc1-79fbd1f43005" by "_copy_volume_from_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:46 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Lock "cinder-quobyte-744e33ca-6729-4487-afc1-79fbd1f43005" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:46 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] snapshot: 1b6d656e-8e78-4120-8727-ed96a892f713, volume: 744e33ca-6729-4487-afc1-79fbd1f43005,  {{(pid=84248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 28 04:45:46 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:46 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:46 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:45:46 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:45:46 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:46 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee45fe2a-dc92-4217-823e-a64e4c3fee89]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:46 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5.1b6d656e-8e78-4120-8727-ed96a892f713 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:46 devstack sudo[88884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5.1b6d656e-8e78-4120-8727-ed96a892f713
Feb 28 04:45:46 devstack sudo[88884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:46 devstack sudo[88879]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:46 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_24yifnlxdevstack@QuobyteHD" returned: 0 in 0.573s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:46 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:46 devstack sudo[88880]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:46 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0daf79b5-85d1-4f68-af32-9c0c699d4d52" returned: 0 in 0.574s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:46 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0daf79b5-85d1-4f68-af32-9c0c699d4d52 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:47 devstack sudo[88891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0daf79b5-85d1-4f68-af32-9c0c699d4d52
Feb 28 04:45:47 devstack sudo[88891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:47 devstack sudo[88884]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:47 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5.1b6d656e-8e78-4120-8727-ed96a892f713" returned: 0 in 0.516s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:47 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:45:47 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] will copy from snapshot at /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5 {{(pid=84248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 28 04:45:47 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Creating direct copy from snapshot {{(pid=84248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 28 04:45:47 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8ac861-4401-4cd5-b3ac-b19ec264b743]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:47 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:47 devstack sudo[88896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5
Feb 28 04:45:47 devstack sudo[88896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:47 devstack sudo[88891]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:47 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0daf79b5-85d1-4f68-af32-9c0c699d4d52" returned: 1 in 0.507s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:47 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0daf79b5-85d1-4f68-af32-9c0c699d4d52' failed. Not Retrying. {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 28 04:45:47 devstack cinder-volume[84248]: DEBUG cinder.volume.volume_utils [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Downloaded image 2c3eb214-ef72-4569-9890-199b020755f9 ((None, [{'url': 'file:///opt/stack/data/glance/images/2c3eb214-ef72-4569-9890-199b020755f9', 'metadata': {}}])) to volume 0daf79b5-85d1-4f68-af32-9c0c699d4d52 successfully. {{(pid=84248) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Feb 28 04:45:47 devstack cinder-volume[84248]: DEBUG cinder.image.image_utils [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Temporary image 2c3eb214-ef72-4569-9890-199b020755f9 for user 44d6aa40c25d4ceeb26300836607fd5b is deleted. {{(pid=84248) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Feb 28 04:45:47 devstack cinder-volume[84248]: DEBUG cinder.volume.volume_utils [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Marking volume 0daf79b5-85d1-4f68-af32-9c0c699d4d52 as bootable. {{(pid=84248) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Feb 28 04:45:47 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Copying metadata from image 2c3eb214-ef72-4569-9890-199b020755f9 to 0daf79b5-85d1-4f68-af32-9c0c699d4d52. {{(pid=84248) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Feb 28 04:45:47 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Creating volume glance metadata for volume 0daf79b5-85d1-4f68-af32-9c0c699d4d52 backed by image 2c3eb214-ef72-4569-9890-199b020755f9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2c3eb214-ef72-4569-9890-199b020755f9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84248) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Feb 28 04:45:47 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba7a2062-8838-4399-9b92-6666e397dbf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0daf79b5-85d1-4f68-af32-9c0c699d4d52', 'volume_size': 1, 'image_id': '2c3eb214-ef72-4569-9890-199b020755f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2c3eb214-ef72-4569-9890-199b020755f9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c0fde1a75874ab3961d0c965899b1f4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2c3eb214-ef72-4569-9890-199b020755f9', 'created_at': datetime.datetime(2026, 2, 28, 3, 36, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 28, 3, 36, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2c3eb214-ef72-4569-9890-199b020755f9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5e40230430>}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:47 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1250c67-2cc3-49d0-9ca9-2893b378aef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:47 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Volume volume-0daf79b5-85d1-4f68-af32-9c0c699d4d52 (0daf79b5-85d1-4f68-af32-9c0c699d4d52): created successfully
Feb 28 04:45:47 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1250c67-2cc3-49d0-9ca9-2893b378aef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:47 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Flow 'volume_create_manager' (0cde0d2c-b033-479a-af37-1a3edd883fc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:45:47 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-3608bd50-6625-4d30-a767-17b988ab29e4 tempest-VolumesExtendTest-215802513 None] Created volume successfully.
Feb 28 04:45:47 devstack sudo[88896]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:47 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5" returned: 0 in 0.526s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:47 devstack cinder-volume[84248]: DEBUG cinder.utils [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Path /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-744e33ca-6729-4487-afc1-79fbd1f43005 not found in is_blk_device check {{(pid=84248) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 28 04:45:47 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-744e33ca-6729-4487-afc1-79fbd1f43005 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:47 devstack sudo[88904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-744e33ca-6729-4487-afc1-79fbd1f43005
Feb 28 04:45:47 devstack sudo[88904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5cdb2667-ce80-4b59-8f3f-b1e73b6dd62a tempest-VolumesExtendTest-215802513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:49 devstack sudo[88904]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-744e33ca-6729-4487-afc1-79fbd1f43005" returned: 0 in 2.212s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:49 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[037cb8f2-b9f7-4433-b0e0-16aa62ab7221]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:49 devstack sudo[88917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5
Feb 28 04:45:49 devstack sudo[88917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:50 devstack sudo[88917]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5" returned: 0 in 0.605s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:50 devstack cinder-volume[84248]: DEBUG cinder.image.image_utils [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Image conversion details: src /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5, size 1024.00 MB, duration 2.21 sec, destination /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-744e33ca-6729-4487-afc1-79fbd1f43005 {{(pid=84248) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 28 04:45:50 devstack cinder-volume[84248]: INFO cinder.image.image_utils [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Converted 1024.00 MB image at 462.83 MB/s
Feb 28 04:45:50 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-744e33ca-6729-4487-afc1-79fbd1f43005 is being set with open permissions: ugo+rw
Feb 28 04:45:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-744e33ca-6729-4487-afc1-79fbd1f43005 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:50 devstack sudo[88922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-744e33ca-6729-4487-afc1-79fbd1f43005
Feb 28 04:45:50 devstack sudo[88922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:50 devstack sudo[88922]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-744e33ca-6729-4487-afc1-79fbd1f43005" returned: 0 in 0.465s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:50 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Lock "cinder-quobyte-744e33ca-6729-4487-afc1-79fbd1f43005" released by "_copy_volume_from_snapshot" :: held 4.370s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:50 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Acquiring lock "cinder-quobyte-1b6d656e-8e78-4120-8727-ed96a892f713" by "_delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:50 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Lock "cinder-quobyte-1b6d656e-8e78-4120-8727-ed96a892f713" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:50 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Deleting offline snapshot 1b6d656e-8e78-4120-8727-ed96a892f713 of volume bd6ced8f-e392-43d0-9111-db3a249fc4f5 {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 04:45:50 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] snapshot_file for this snap is: volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5.1b6d656e-8e78-4120-8727-ed96a892f713 {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 04:45:50 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4095be-2524-4521-9324-6caf04fda608]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5.1b6d656e-8e78-4120-8727-ed96a892f713 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:51 devstack sudo[88925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5.1b6d656e-8e78-4120-8727-ed96a892f713
Feb 28 04:45:51 devstack sudo[88925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:51 devstack sudo[88925]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5.1b6d656e-8e78-4120-8727-ed96a892f713" returned: 0 in 0.551s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:51 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:45:51 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[e664a61e-554c-46f9-b0bd-a881fdf0d84e]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:51 devstack sudo[88932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5
Feb 28 04:45:51 devstack sudo[88932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:52 devstack sudo[88932]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5" returned: 0 in 0.512s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5.1b6d656e-8e78-4120-8727-ed96a892f713 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:52 devstack sudo[88937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5.1b6d656e-8e78-4120-8727-ed96a892f713
Feb 28 04:45:52 devstack sudo[88937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:52 devstack sudo[88937]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5.1b6d656e-8e78-4120-8727-ed96a892f713" returned: 0 in 0.472s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5.1b6d656e-8e78-4120-8727-ed96a892f713 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:52 devstack sudo[88942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5.1b6d656e-8e78-4120-8727-ed96a892f713
Feb 28 04:45:52 devstack sudo[88942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:52 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-fd43d339-9327-4994-b8b7-af013024ad09 tempest-GroupsTest-587314363 None] Group tempest-Group1-69785535: creating
Feb 28 04:45:52 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-fd43d339-9327-4994-b8b7-af013024ad09 tempest-GroupsTest-587314363 None] Group tempest-Group1-69785535: created successfully
Feb 28 04:45:52 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-fd43d339-9327-4994-b8b7-af013024ad09 tempest-GroupsTest-587314363 None] Create group completed successfully.
Feb 28 04:45:52 devstack sudo[88942]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5.1b6d656e-8e78-4120-8727-ed96a892f713" returned: 0 in 0.437s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:52 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Lock "cinder-quobyte-1b6d656e-8e78-4120-8727-ed96a892f713" released by "_delete_snapshot" :: held 2.018s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.779s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.109s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:52 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-243185223',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ff513bc-4bc3-43f5-96da-af4908a5c7ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffa5b3079f3d44ca94e4307cea1cffe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:45:45Z,use_quota=True,user_id='cf4aa8f4cb1d451c8c3b3fa1dc9ac3d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:45:52 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Creating volume 6ff513bc-4bc3-43f5-96da-af4908a5c7ca {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:45:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:52 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:45:52 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:45:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:52 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:45:52 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:45:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6ff513bc-4bc3-43f5-96da-af4908a5c7ca 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:53 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11636cd9-bb06-4c37-8ad7-0163c4a8b9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-744e33ca-6729-4487-afc1-79fbd1f43005', 'volume_size': 1, 'source_volid': 'bd6ced8f-e392-43d0-9111-db3a249fc4f5', 'source_volstatus': 'available'}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:53 devstack sudo[88945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6ff513bc-4bc3-43f5-96da-af4908a5c7ca 1073741824
Feb 28 04:45:53 devstack sudo[88945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:53 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e7ef0a7-a5f3-479b-82ac-c36efeada8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:53 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Volume volume-744e33ca-6729-4487-afc1-79fbd1f43005 (744e33ca-6729-4487-afc1-79fbd1f43005): created successfully
Feb 28 04:45:53 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e7ef0a7-a5f3-479b-82ac-c36efeada8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:53 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Flow 'volume_create_manager' (dbfd36ef-c001-4de5-8d9c-029f340fba53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:45:53 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-dd21f04f-ec2b-4f48-a320-86167c7fa749 tempest-VolumesGetTest-507974651 None] Created volume successfully.
Feb 28 04:45:53 devstack sudo[88945]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6ff513bc-4bc3-43f5-96da-af4908a5c7ca 1073741824" returned: 0 in 0.488s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6ff513bc-4bc3-43f5-96da-af4908a5c7ca {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:53 devstack sudo[88950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6ff513bc-4bc3-43f5-96da-af4908a5c7ca
Feb 28 04:45:53 devstack sudo[88950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:53 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-84d32397-cca1-472b-81e4-d845c1bef2f5 tempest-GroupsTest-587314363 None] Group tempest-Group2-1425693866: creating
Feb 28 04:45:53 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-84d32397-cca1-472b-81e4-d845c1bef2f5 tempest-GroupsTest-587314363 None] Group tempest-Group2-1425693866: created successfully
Feb 28 04:45:53 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-84d32397-cca1-472b-81e4-d845c1bef2f5 tempest-GroupsTest-587314363 None] Create group completed successfully.
Feb 28 04:45:53 devstack sudo[88950]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6ff513bc-4bc3-43f5-96da-af4908a5c7ca" returned: 0 in 0.490s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:53 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:45:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5cdb2667-ce80-4b59-8f3f-b1e73b6dd62a tempest-VolumesExtendTest-215802513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 4.734s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:54 devstack cinder-volume[84248]: DEBUG cinder.volume.volume_utils [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Attempting download of 2c3eb214-ef72-4569-9890-199b020755f9 ((None, [{'url': 'file:///opt/stack/data/glance/images/2c3eb214-ef72-4569-9890-199b020755f9', 'metadata': {}}])) to volume 6ff513bc-4bc3-43f5-96da-af4908a5c7ca. {{(pid=84248) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Feb 28 04:45:54 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[2623bb96-dd57-4cba-8168-2e12f6d9cbe7]: (4, 'raw') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5cdb2667-ce80-4b59-8f3f-b1e73b6dd62a tempest-VolumesExtendTest-215802513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0daf79b5-85d1-4f68-af32-9c0c699d4d52 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:54 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf02263-3d64-458a-b538-8e2b8a13074e]: (4, 'raw') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2c3eb214-ef72-4569-9890-199b020755f9_k2pgxh70 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:54 devstack sudo[88953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0daf79b5-85d1-4f68-af32-9c0c699d4d52
Feb 28 04:45:54 devstack sudo[88953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:54 devstack sudo[88954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2c3eb214-ef72-4569-9890-199b020755f9_k2pgxh70
Feb 28 04:45:54 devstack sudo[88954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:54 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee1d4b2d-eb98-4fcf-aca2-babc537459ff tempest-VolumesGetTest-507974651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:45:54 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ee1d4b2d-eb98-4fcf-aca2-babc537459ff tempest-VolumesGetTest-507974651 None] Flow 'volume_create_manager' (d8d10a31-f593-44ca-88f4-d921f7ae4d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:45:54 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ee1d4b2d-eb98-4fcf-aca2-babc537459ff tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (480c23ec-4c88-4181-a162-ae24f996e292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:54 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ee1d4b2d-eb98-4fcf-aca2-babc537459ff tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (480c23ec-4c88-4181-a162-ae24f996e292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:45:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-686652329',display_name='tempest-VolumesGetTest-Volume-134140923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=314ea06f-14ad-4404-a6c1-d6e0d37aebcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='992ba50d9e4a432fbe7b2db9bbd34498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:45:54Z,use_quota=True,user_id='2247d4e35589438db75df793320c521a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:54 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ee1d4b2d-eb98-4fcf-aca2-babc537459ff tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b362704-8a8b-4aa5-b5d5-06e0088c483d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:54 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ee1d4b2d-eb98-4fcf-aca2-babc537459ff tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b362704-8a8b-4aa5-b5d5-06e0088c483d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:54 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ee1d4b2d-eb98-4fcf-aca2-babc537459ff tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6acb4784-8ede-44c6-9fd9-f34281f22206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:54 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ee1d4b2d-eb98-4fcf-aca2-babc537459ff tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6acb4784-8ede-44c6-9fd9-f34281f22206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '314ea06f-14ad-4404-a6c1-d6e0d37aebcc', 'volume_name': 'volume-314ea06f-14ad-4404-a6c1-d6e0d37aebcc', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:54 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ee1d4b2d-eb98-4fcf-aca2-babc537459ff tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5602c051-eb20-4606-aeeb-f3b6f827c119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:54 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ee1d4b2d-eb98-4fcf-aca2-babc537459ff tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5602c051-eb20-4606-aeeb-f3b6f827c119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:54 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ee1d4b2d-eb98-4fcf-aca2-babc537459ff tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15f98773-29e0-4bc0-b47c-b82dfd6f14b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:54 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-ee1d4b2d-eb98-4fcf-aca2-babc537459ff tempest-VolumesGetTest-507974651 None] Volume 314ea06f-14ad-4404-a6c1-d6e0d37aebcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-314ea06f-14ad-4404-a6c1-d6e0d37aebcc', 'volume_size': 1}
Feb 28 04:45:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ee1d4b2d-eb98-4fcf-aca2-babc537459ff tempest-VolumesGetTest-507974651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:54 devstack sudo[88953]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5cdb2667-ce80-4b59-8f3f-b1e73b6dd62a tempest-VolumesExtendTest-215802513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0daf79b5-85d1-4f68-af32-9c0c699d4d52" returned: 0 in 0.504s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5cdb2667-ce80-4b59-8f3f-b1e73b6dd62a tempest-VolumesExtendTest-215802513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0daf79b5-85d1-4f68-af32-9c0c699d4d52 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:54 devstack sudo[88954]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2c3eb214-ef72-4569-9890-199b020755f9_k2pgxh70" returned: 0 in 0.487s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c3eb214-ef72-4569-9890-199b020755f9_k2pgxh70 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:54 devstack sudo[88961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0daf79b5-85d1-4f68-af32-9c0c699d4d52
Feb 28 04:45:54 devstack sudo[88961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:54 devstack sudo[88962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c3eb214-ef72-4569-9890-199b020755f9_k2pgxh70
Feb 28 04:45:54 devstack sudo[88962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:55 devstack sudo[88962]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c3eb214-ef72-4569-9890-199b020755f9_k2pgxh70" returned: 1 in 0.496s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c3eb214-ef72-4569-9890-199b020755f9_k2pgxh70' failed. Not Retrying. {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 28 04:45:55 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43e1b60-de4a-4368-b81d-34e22cfd57ca]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_24yifnlxdevstack@QuobyteHD {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:55 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-29c536a1-22db-4666-b2aa-25676ca7c8e4 tempest-GroupsTest-587314363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:45:55 devstack sudo[88961]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:55 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-29c536a1-22db-4666-b2aa-25676ca7c8e4 tempest-GroupsTest-587314363 None] Flow 'volume_create_manager' (32c4fbcf-8739-46ab-b890-82bd6ea9ddb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:45:55 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-29c536a1-22db-4666-b2aa-25676ca7c8e4 tempest-GroupsTest-587314363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47301657-a09b-4db4-8adb-85e269e5cbe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:55 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-29c536a1-22db-4666-b2aa-25676ca7c8e4 tempest-GroupsTest-587314363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47301657-a09b-4db4-8adb-85e269e5cbe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:45:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-525160063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=838784f7-535b-4e5d-934c-878dac52d51b,host='devstack@QuobyteHD#QuobyteHD',id=069f65f0-193b-48a1-8ecd-86ffb224ccc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d97dd0d71b574da1aac715b35e36a4a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:45:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:45:55Z,use_quota=True,user_id='a295ca4d8b844e75a20e7d248aacd54c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75ef2e79-012f-4c67-85ac-56b44dcc3d0e),volume_type_id=75ef2e79-012f-4c67-85ac-56b44dcc3d0e)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:55 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-29c536a1-22db-4666-b2aa-25676ca7c8e4 tempest-GroupsTest-587314363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6e7921e-2674-4418-ae05-edc6bcb952c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:55 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-29c536a1-22db-4666-b2aa-25676ca7c8e4 tempest-GroupsTest-587314363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6e7921e-2674-4418-ae05-edc6bcb952c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:55 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-29c536a1-22db-4666-b2aa-25676ca7c8e4 tempest-GroupsTest-587314363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a1661d3-a922-4237-99a4-8a451e34f811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:55 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-29c536a1-22db-4666-b2aa-25676ca7c8e4 tempest-GroupsTest-587314363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a1661d3-a922-4237-99a4-8a451e34f811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '069f65f0-193b-48a1-8ecd-86ffb224ccc1', 'volume_name': 'volume-069f65f0-193b-48a1-8ecd-86ffb224ccc1', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:55 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-29c536a1-22db-4666-b2aa-25676ca7c8e4 tempest-GroupsTest-587314363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06def6ed-a7d4-4180-8df0-e6f8e37a8a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:55 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-29c536a1-22db-4666-b2aa-25676ca7c8e4 tempest-GroupsTest-587314363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06def6ed-a7d4-4180-8df0-e6f8e37a8a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:55 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-29c536a1-22db-4666-b2aa-25676ca7c8e4 tempest-GroupsTest-587314363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e45d93c0-2e6d-4b60-81f7-1a8480efec72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:55 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-29c536a1-22db-4666-b2aa-25676ca7c8e4 tempest-GroupsTest-587314363 None] Volume 069f65f0-193b-48a1-8ecd-86ffb224ccc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-069f65f0-193b-48a1-8ecd-86ffb224ccc1', 'volume_size': 1}
Feb 28 04:45:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-29c536a1-22db-4666-b2aa-25676ca7c8e4 tempest-GroupsTest-587314363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5cdb2667-ce80-4b59-8f3f-b1e73b6dd62a tempest-VolumesExtendTest-215802513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0daf79b5-85d1-4f68-af32-9c0c699d4d52" returned: 1 in 0.602s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5cdb2667-ce80-4b59-8f3f-b1e73b6dd62a tempest-VolumesExtendTest-215802513 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0daf79b5-85d1-4f68-af32-9c0c699d4d52' failed. Not Retrying. {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 28 04:45:55 devstack sudo[88970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_24yifnlxdevstack@QuobyteHD
Feb 28 04:45:55 devstack sudo[88970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5cdb2667-ce80-4b59-8f3f-b1e73b6dd62a tempest-VolumesExtendTest-215802513 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0daf79b5-85d1-4f68-af32-9c0c699d4d52 2G {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5cdb2667-ce80-4b59-8f3f-b1e73b6dd62a tempest-VolumesExtendTest-215802513 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0daf79b5-85d1-4f68-af32-9c0c699d4d52 2G" returned: 0 in 0.035s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5cdb2667-ce80-4b59-8f3f-b1e73b6dd62a tempest-VolumesExtendTest-215802513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.169s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ee1d4b2d-eb98-4fcf-aca2-babc537459ff tempest-VolumesGetTest-507974651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.843s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:55 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-ee1d4b2d-eb98-4fcf-aca2-babc537459ff tempest-VolumesGetTest-507974651 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:45:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-686652329',display_name='tempest-VolumesGetTest-Volume-134140923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=314ea06f-14ad-4404-a6c1-d6e0d37aebcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='992ba50d9e4a432fbe7b2db9bbd34498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:45:54Z,use_quota=True,user_id='2247d4e35589438db75df793320c521a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:45:55 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-ee1d4b2d-eb98-4fcf-aca2-babc537459ff tempest-VolumesGetTest-507974651 None] Creating volume 314ea06f-14ad-4404-a6c1-d6e0d37aebcc {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:45:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ee1d4b2d-eb98-4fcf-aca2-babc537459ff tempest-VolumesGetTest-507974651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ee1d4b2d-eb98-4fcf-aca2-babc537459ff tempest-VolumesGetTest-507974651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:55 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-ee1d4b2d-eb98-4fcf-aca2-babc537459ff tempest-VolumesGetTest-507974651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:45:55 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-ee1d4b2d-eb98-4fcf-aca2-babc537459ff tempest-VolumesGetTest-507974651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:45:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ee1d4b2d-eb98-4fcf-aca2-babc537459ff tempest-VolumesGetTest-507974651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:55 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-ee1d4b2d-eb98-4fcf-aca2-babc537459ff tempest-VolumesGetTest-507974651 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:45:55 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-ee1d4b2d-eb98-4fcf-aca2-babc537459ff tempest-VolumesGetTest-507974651 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:45:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ee1d4b2d-eb98-4fcf-aca2-babc537459ff tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-314ea06f-14ad-4404-a6c1-d6e0d37aebcc 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:55 devstack sudo[88975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-314ea06f-14ad-4404-a6c1-d6e0d37aebcc 1073741824
Feb 28 04:45:55 devstack sudo[88975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:55 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-5cdb2667-ce80-4b59-8f3f-b1e73b6dd62a tempest-VolumesExtendTest-215802513 None] Extend volume completed successfully.
Feb 28 04:45:55 devstack sudo[88970]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_24yifnlxdevstack@QuobyteHD" returned: 0 in 0.492s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:55 devstack cinder-volume[84248]: DEBUG cinder.image.image_utils [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] 2c3eb214-ef72-4569-9890-199b020755f9 was qcow2, converting to raw {{(pid=84248) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Feb 28 04:45:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_24yifnlxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6ff513bc-4bc3-43f5-96da-af4908a5c7ca {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:55 devstack sudo[88983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_24yifnlxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6ff513bc-4bc3-43f5-96da-af4908a5c7ca
Feb 28 04:45:55 devstack sudo[88983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:55 devstack sudo[88975]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ee1d4b2d-eb98-4fcf-aca2-babc537459ff tempest-VolumesGetTest-507974651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-314ea06f-14ad-4404-a6c1-d6e0d37aebcc 1073741824" returned: 0 in 0.503s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ee1d4b2d-eb98-4fcf-aca2-babc537459ff tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-314ea06f-14ad-4404-a6c1-d6e0d37aebcc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:55 devstack sudo[88985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-314ea06f-14ad-4404-a6c1-d6e0d37aebcc
Feb 28 04:45:55 devstack sudo[88985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:55 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8282f38c-9fb7-4d49-8610-2e0eb73b9e44 tempest-VolumesExtendTest-215802513 None] Acquiring lock "cinder-0daf79b5-85d1-4f68-af32-9c0c699d4d52-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:55 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8282f38c-9fb7-4d49-8610-2e0eb73b9e44 tempest-VolumesExtendTest-215802513 None] Lock "cinder-0daf79b5-85d1-4f68-af32-9c0c699d4d52-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:55 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8282f38c-9fb7-4d49-8610-2e0eb73b9e44 tempest-VolumesExtendTest-215802513 None] Acquiring lock "cinder-quobyte-0daf79b5-85d1-4f68-af32-9c0c699d4d52" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:55 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8282f38c-9fb7-4d49-8610-2e0eb73b9e44 tempest-VolumesExtendTest-215802513 None] Lock "cinder-quobyte-0daf79b5-85d1-4f68-af32-9c0c699d4d52" acquired by "delete_volume" :: waited 0.006s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:55 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[4023de2c-81ee-4406-a75a-c47c1fcce041]: (4, 'raw') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8282f38c-9fb7-4d49-8610-2e0eb73b9e44 tempest-VolumesExtendTest-215802513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0daf79b5-85d1-4f68-af32-9c0c699d4d52 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:55 devstack sudo[88987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0daf79b5-85d1-4f68-af32-9c0c699d4d52
Feb 28 04:45:55 devstack sudo[88987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:56 devstack sudo[88985]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:56 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ee1d4b2d-eb98-4fcf-aca2-babc537459ff tempest-VolumesGetTest-507974651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-314ea06f-14ad-4404-a6c1-d6e0d37aebcc" returned: 0 in 0.504s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:56 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-ee1d4b2d-eb98-4fcf-aca2-babc537459ff tempest-VolumesGetTest-507974651 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:45:56 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ee1d4b2d-eb98-4fcf-aca2-babc537459ff tempest-VolumesGetTest-507974651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:56 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-29c536a1-22db-4666-b2aa-25676ca7c8e4 tempest-GroupsTest-587314363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.100s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:56 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-29c536a1-22db-4666-b2aa-25676ca7c8e4 tempest-GroupsTest-587314363 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=838784f7-535b-4e5d-934c-878dac52d51b,created_at=2026-02-28T03:45:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-525160063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=838784f7-535b-4e5d-934c-878dac52d51b,host='devstack@QuobyteHD#QuobyteHD',id=069f65f0-193b-48a1-8ecd-86ffb224ccc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d97dd0d71b574da1aac715b35e36a4a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:45:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:45:55Z,use_quota=True,user_id='a295ca4d8b844e75a20e7d248aacd54c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75ef2e79-012f-4c67-85ac-56b44dcc3d0e),volume_type_id=75ef2e79-012f-4c67-85ac-56b44dcc3d0e)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:45:56 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-29c536a1-22db-4666-b2aa-25676ca7c8e4 tempest-GroupsTest-587314363 None] Creating volume 069f65f0-193b-48a1-8ecd-86ffb224ccc1 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:45:56 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-29c536a1-22db-4666-b2aa-25676ca7c8e4 tempest-GroupsTest-587314363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:56 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-29c536a1-22db-4666-b2aa-25676ca7c8e4 tempest-GroupsTest-587314363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:56 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-29c536a1-22db-4666-b2aa-25676ca7c8e4 tempest-GroupsTest-587314363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:45:56 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-29c536a1-22db-4666-b2aa-25676ca7c8e4 tempest-GroupsTest-587314363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:45:56 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-29c536a1-22db-4666-b2aa-25676ca7c8e4 tempest-GroupsTest-587314363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:56 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-29c536a1-22db-4666-b2aa-25676ca7c8e4 tempest-GroupsTest-587314363 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:45:56 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-29c536a1-22db-4666-b2aa-25676ca7c8e4 tempest-GroupsTest-587314363 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:45:56 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-29c536a1-22db-4666-b2aa-25676ca7c8e4 tempest-GroupsTest-587314363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-069f65f0-193b-48a1-8ecd-86ffb224ccc1 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:56 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ee1d4b2d-eb98-4fcf-aca2-babc537459ff tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15f98773-29e0-4bc0-b47c-b82dfd6f14b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-314ea06f-14ad-4404-a6c1-d6e0d37aebcc', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:56 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ee1d4b2d-eb98-4fcf-aca2-babc537459ff tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24a045b1-da60-4e18-931d-3ecb75b7e81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:56 devstack sudo[89006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-069f65f0-193b-48a1-8ecd-86ffb224ccc1 1073741824
Feb 28 04:45:56 devstack sudo[89006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:56 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-ee1d4b2d-eb98-4fcf-aca2-babc537459ff tempest-VolumesGetTest-507974651 None] Volume volume-314ea06f-14ad-4404-a6c1-d6e0d37aebcc (314ea06f-14ad-4404-a6c1-d6e0d37aebcc): created successfully
Feb 28 04:45:56 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ee1d4b2d-eb98-4fcf-aca2-babc537459ff tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24a045b1-da60-4e18-931d-3ecb75b7e81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:56 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ee1d4b2d-eb98-4fcf-aca2-babc537459ff tempest-VolumesGetTest-507974651 None] Flow 'volume_create_manager' (d8d10a31-f593-44ca-88f4-d921f7ae4d00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:45:56 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-ee1d4b2d-eb98-4fcf-aca2-babc537459ff tempest-VolumesGetTest-507974651 None] Created volume successfully.
Feb 28 04:45:56 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-03d47cf4-7288-43a6-830a-fdd90d744d53 tempest-VolumesGetTest-507974651 None] Acquiring lock "cinder-314ea06f-14ad-4404-a6c1-d6e0d37aebcc-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:56 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-03d47cf4-7288-43a6-830a-fdd90d744d53 tempest-VolumesGetTest-507974651 None] Lock "cinder-314ea06f-14ad-4404-a6c1-d6e0d37aebcc-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:56 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-03d47cf4-7288-43a6-830a-fdd90d744d53 tempest-VolumesGetTest-507974651 None] Acquiring lock "cinder-quobyte-314ea06f-14ad-4404-a6c1-d6e0d37aebcc" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:56 devstack sudo[88983]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:56 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-03d47cf4-7288-43a6-830a-fdd90d744d53 tempest-VolumesGetTest-507974651 None] Lock "cinder-quobyte-314ea06f-14ad-4404-a6c1-d6e0d37aebcc" acquired by "delete_volume" :: waited 0.009s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:56 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_24yifnlxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6ff513bc-4bc3-43f5-96da-af4908a5c7ca" returned: 0 in 1.019s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:56 devstack cinder-volume[84248]: DEBUG cinder.image.image_utils [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_24yifnlxdevstack@QuobyteHD, size 112.00 MB, duration 1.02 sec, destination /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6ff513bc-4bc3-43f5-96da-af4908a5c7ca {{(pid=84248) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 28 04:45:56 devstack cinder-volume[84248]: INFO cinder.image.image_utils [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Converted 112.00 MB image at 109.79 MB/s
Feb 28 04:45:56 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6ff513bc-4bc3-43f5-96da-af4908a5c7ca 1G {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:56 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a9f24e-d4c5-4875-be0e-4f1e964d2112]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:56 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-03d47cf4-7288-43a6-830a-fdd90d744d53 tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-314ea06f-14ad-4404-a6c1-d6e0d37aebcc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:56 devstack sudo[89010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6ff513bc-4bc3-43f5-96da-af4908a5c7ca 1G
Feb 28 04:45:56 devstack sudo[89010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:56 devstack sudo[88987]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:56 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8282f38c-9fb7-4d49-8610-2e0eb73b9e44 tempest-VolumesExtendTest-215802513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0daf79b5-85d1-4f68-af32-9c0c699d4d52" returned: 0 in 0.686s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:56 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8282f38c-9fb7-4d49-8610-2e0eb73b9e44 tempest-VolumesExtendTest-215802513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0daf79b5-85d1-4f68-af32-9c0c699d4d52 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:56 devstack sudo[89013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0daf79b5-85d1-4f68-af32-9c0c699d4d52
Feb 28 04:45:56 devstack sudo[89011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-314ea06f-14ad-4404-a6c1-d6e0d37aebcc
Feb 28 04:45:56 devstack sudo[89011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:56 devstack sudo[89013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:56 devstack sudo[89006]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:56 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-29c536a1-22db-4666-b2aa-25676ca7c8e4 tempest-GroupsTest-587314363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-069f65f0-193b-48a1-8ecd-86ffb224ccc1 1073741824" returned: 0 in 0.596s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:56 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-29c536a1-22db-4666-b2aa-25676ca7c8e4 tempest-GroupsTest-587314363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-069f65f0-193b-48a1-8ecd-86ffb224ccc1 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:56 devstack sudo[89019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-069f65f0-193b-48a1-8ecd-86ffb224ccc1
Feb 28 04:45:56 devstack sudo[89019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:57 devstack sudo[89010]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:57 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6ff513bc-4bc3-43f5-96da-af4908a5c7ca 1G" returned: 0 in 0.484s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:57 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[83956218-a4c7-4603-9d98-ff9ad64e1ba6]: (4, 'raw') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:57 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6ff513bc-4bc3-43f5-96da-af4908a5c7ca {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:57 devstack sudo[89011]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:57 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-03d47cf4-7288-43a6-830a-fdd90d744d53 tempest-VolumesGetTest-507974651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-314ea06f-14ad-4404-a6c1-d6e0d37aebcc" returned: 0 in 0.542s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:57 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-03d47cf4-7288-43a6-830a-fdd90d744d53 tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-314ea06f-14ad-4404-a6c1-d6e0d37aebcc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:57 devstack sudo[89031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-314ea06f-14ad-4404-a6c1-d6e0d37aebcc
Feb 28 04:45:57 devstack sudo[89031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:57 devstack sudo[89013]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:57 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8282f38c-9fb7-4d49-8610-2e0eb73b9e44 tempest-VolumesExtendTest-215802513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0daf79b5-85d1-4f68-af32-9c0c699d4d52" returned: 1 in 0.559s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:57 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8282f38c-9fb7-4d49-8610-2e0eb73b9e44 tempest-VolumesExtendTest-215802513 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0daf79b5-85d1-4f68-af32-9c0c699d4d52' failed. Not Retrying. {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 28 04:45:57 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8282f38c-9fb7-4d49-8610-2e0eb73b9e44 tempest-VolumesExtendTest-215802513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0daf79b5-85d1-4f68-af32-9c0c699d4d52 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:57 devstack sudo[89030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6ff513bc-4bc3-43f5-96da-af4908a5c7ca
Feb 28 04:45:57 devstack sudo[89030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:57 devstack sudo[89033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0daf79b5-85d1-4f68-af32-9c0c699d4d52
Feb 28 04:45:57 devstack sudo[89033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:57 devstack sudo[89019]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:57 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-29c536a1-22db-4666-b2aa-25676ca7c8e4 tempest-GroupsTest-587314363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-069f65f0-193b-48a1-8ecd-86ffb224ccc1" returned: 0 in 0.461s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:57 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-29c536a1-22db-4666-b2aa-25676ca7c8e4 tempest-GroupsTest-587314363 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:45:57 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-29c536a1-22db-4666-b2aa-25676ca7c8e4 tempest-GroupsTest-587314363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:57 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-29c536a1-22db-4666-b2aa-25676ca7c8e4 tempest-GroupsTest-587314363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e45d93c0-2e6d-4b60-81f7-1a8480efec72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-069f65f0-193b-48a1-8ecd-86ffb224ccc1', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:57 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-29c536a1-22db-4666-b2aa-25676ca7c8e4 tempest-GroupsTest-587314363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (055eca66-f390-4bd6-8674-769d66f6be9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:57 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-29c536a1-22db-4666-b2aa-25676ca7c8e4 tempest-GroupsTest-587314363 None] Volume volume-069f65f0-193b-48a1-8ecd-86ffb224ccc1 (069f65f0-193b-48a1-8ecd-86ffb224ccc1): created successfully
Feb 28 04:45:57 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-29c536a1-22db-4666-b2aa-25676ca7c8e4 tempest-GroupsTest-587314363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (055eca66-f390-4bd6-8674-769d66f6be9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:57 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-29c536a1-22db-4666-b2aa-25676ca7c8e4 tempest-GroupsTest-587314363 None] Flow 'volume_create_manager' (32c4fbcf-8739-46ab-b890-82bd6ea9ddb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:45:57 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-29c536a1-22db-4666-b2aa-25676ca7c8e4 tempest-GroupsTest-587314363 None] Created volume successfully.
Feb 28 04:45:57 devstack sudo[89031]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:57 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-03d47cf4-7288-43a6-830a-fdd90d744d53 tempest-VolumesGetTest-507974651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-314ea06f-14ad-4404-a6c1-d6e0d37aebcc" returned: 0 in 0.444s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:57 devstack sudo[89033]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:57 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8282f38c-9fb7-4d49-8610-2e0eb73b9e44 tempest-VolumesExtendTest-215802513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0daf79b5-85d1-4f68-af32-9c0c699d4d52" returned: 0 in 0.410s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:57 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-03d47cf4-7288-43a6-830a-fdd90d744d53 tempest-VolumesGetTest-507974651 None] Lock "cinder-quobyte-314ea06f-14ad-4404-a6c1-d6e0d37aebcc" released by "delete_volume" :: held 1.020s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:57 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8282f38c-9fb7-4d49-8610-2e0eb73b9e44 tempest-VolumesExtendTest-215802513 None] Lock "cinder-quobyte-0daf79b5-85d1-4f68-af32-9c0c699d4d52" released by "delete_volume" :: held 1.710s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:57 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-03d47cf4-7288-43a6-830a-fdd90d744d53 tempest-VolumesGetTest-507974651 None] Created reservations ['42edc92e-2b25-4415-9aa6-4570cec1263b', '8b278db3-b81a-4d3c-a8bf-403fc3f980c5', '7cd849d7-c96e-4a50-9304-702c34352c99', 'd00483b2-56eb-4c55-8e5d-db543fdd99cf'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:45:57 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-8282f38c-9fb7-4d49-8610-2e0eb73b9e44 tempest-VolumesExtendTest-215802513 None] Created reservations ['1d8401b1-9d93-480f-9441-ba74ee8e3311', 'f17fc6d7-a98e-4caa-8d30-d55d0a533b35', '54d651a5-d274-4d1c-893a-1398db5ad346', '45024db7-94f1-4ac2-885c-f38fd0922adf'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:45:57 devstack sudo[89030]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:57 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6ff513bc-4bc3-43f5-96da-af4908a5c7ca" returned: 0 in 0.596s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:57 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-8282f38c-9fb7-4d49-8610-2e0eb73b9e44 tempest-VolumesExtendTest-215802513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:57 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-8282f38c-9fb7-4d49-8610-2e0eb73b9e44 tempest-VolumesExtendTest-215802513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:57 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-8282f38c-9fb7-4d49-8610-2e0eb73b9e44 tempest-VolumesExtendTest-215802513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:45:57 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-8282f38c-9fb7-4d49-8610-2e0eb73b9e44 tempest-VolumesExtendTest-215802513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:45:57 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-8282f38c-9fb7-4d49-8610-2e0eb73b9e44 tempest-VolumesExtendTest-215802513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:57 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8282f38c-9fb7-4d49-8610-2e0eb73b9e44 tempest-VolumesExtendTest-215802513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:57 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6ff513bc-4bc3-43f5-96da-af4908a5c7ca {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:57 devstack sudo[89041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:45:57 devstack sudo[89041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:57 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-03d47cf4-7288-43a6-830a-fdd90d744d53 tempest-VolumesGetTest-507974651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:57 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-03d47cf4-7288-43a6-830a-fdd90d744d53 tempest-VolumesGetTest-507974651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:57 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-03d47cf4-7288-43a6-830a-fdd90d744d53 tempest-VolumesGetTest-507974651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:45:57 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-03d47cf4-7288-43a6-830a-fdd90d744d53 tempest-VolumesGetTest-507974651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:45:57 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-03d47cf4-7288-43a6-830a-fdd90d744d53 tempest-VolumesGetTest-507974651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:57 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-03d47cf4-7288-43a6-830a-fdd90d744d53 tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:57 devstack sudo[89044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:45:57 devstack sudo[89044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:57 devstack sudo[89042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6ff513bc-4bc3-43f5-96da-af4908a5c7ca
Feb 28 04:45:57 devstack sudo[89042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:58 devstack sudo[89041]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8282f38c-9fb7-4d49-8610-2e0eb73b9e44 tempest-VolumesExtendTest-215802513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.415s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-8282f38c-9fb7-4d49-8610-2e0eb73b9e44 tempest-VolumesExtendTest-215802513 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:45:58 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-8282f38c-9fb7-4d49-8610-2e0eb73b9e44 tempest-VolumesExtendTest-215802513 None] Deleted volume successfully.
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8282f38c-9fb7-4d49-8610-2e0eb73b9e44 tempest-VolumesExtendTest-215802513 None] Lock "cinder-0daf79b5-85d1-4f68-af32-9c0c699d4d52-delete_volume" released by "delete_volume" :: held 2.281s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:58 devstack sudo[89044]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-03d47cf4-7288-43a6-830a-fdd90d744d53 tempest-VolumesGetTest-507974651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.460s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-03d47cf4-7288-43a6-830a-fdd90d744d53 tempest-VolumesGetTest-507974651 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:45:58 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-03d47cf4-7288-43a6-830a-fdd90d744d53 tempest-VolumesGetTest-507974651 None] Deleted volume successfully.
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-03d47cf4-7288-43a6-830a-fdd90d744d53 tempest-VolumesGetTest-507974651 None] Lock "cinder-314ea06f-14ad-4404-a6c1-d6e0d37aebcc-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:58 devstack sudo[89042]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6ff513bc-4bc3-43f5-96da-af4908a5c7ca" returned: 1 in 0.573s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6ff513bc-4bc3-43f5-96da-af4908a5c7ca' failed. Not Retrying. {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG cinder.volume.volume_utils [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Downloaded image 2c3eb214-ef72-4569-9890-199b020755f9 ((None, [{'url': 'file:///opt/stack/data/glance/images/2c3eb214-ef72-4569-9890-199b020755f9', 'metadata': {}}])) to volume 6ff513bc-4bc3-43f5-96da-af4908a5c7ca successfully. {{(pid=84248) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG cinder.image.image_utils [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Temporary image 2c3eb214-ef72-4569-9890-199b020755f9 for user cf4aa8f4cb1d451c8c3b3fa1dc9ac3d4 is deleted. {{(pid=84248) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG cinder.volume.volume_utils [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Marking volume 6ff513bc-4bc3-43f5-96da-af4908a5c7ca as bootable. {{(pid=84248) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-58257b93-f7fb-4480-b32d-23b01787e9cc tempest-VolumesExtendTest-215802513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-58257b93-f7fb-4480-b32d-23b01787e9cc tempest-VolumesExtendTest-215802513 None] Flow 'volume_create_manager' (cf5073c3-235f-4aa4-adb8-88b6759d3279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-58257b93-f7fb-4480-b32d-23b01787e9cc tempest-VolumesExtendTest-215802513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70c77a48-97e5-4c6a-96a9-486cf6923b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Copying metadata from image 2c3eb214-ef72-4569-9890-199b020755f9 to 6ff513bc-4bc3-43f5-96da-af4908a5c7ca. {{(pid=84248) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Creating volume glance metadata for volume 6ff513bc-4bc3-43f5-96da-af4908a5c7ca backed by image 2c3eb214-ef72-4569-9890-199b020755f9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2c3eb214-ef72-4569-9890-199b020755f9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84248) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-58257b93-f7fb-4480-b32d-23b01787e9cc tempest-VolumesExtendTest-215802513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70c77a48-97e5-4c6a-96a9-486cf6923b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1574904183',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19dc8bd6-5076-4ff6-92a9-8125f984b4a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e377809876f4437e8cccf021ae48e17a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:45:58Z,use_quota=True,user_id='44d6aa40c25d4ceeb26300836607fd5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-58257b93-f7fb-4480-b32d-23b01787e9cc tempest-VolumesExtendTest-215802513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ea3633a-b720-482f-8ddf-5c138087e6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-58257b93-f7fb-4480-b32d-23b01787e9cc tempest-VolumesExtendTest-215802513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ea3633a-b720-482f-8ddf-5c138087e6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-58257b93-f7fb-4480-b32d-23b01787e9cc tempest-VolumesExtendTest-215802513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed9c81a8-c7b8-4642-9488-1c2afd51aee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-58257b93-f7fb-4480-b32d-23b01787e9cc tempest-VolumesExtendTest-215802513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed9c81a8-c7b8-4642-9488-1c2afd51aee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19dc8bd6-5076-4ff6-92a9-8125f984b4a5', 'volume_name': 'volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-58257b93-f7fb-4480-b32d-23b01787e9cc tempest-VolumesExtendTest-215802513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d5d8727-cb97-4e05-a401-3bfbab68e8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-58257b93-f7fb-4480-b32d-23b01787e9cc tempest-VolumesExtendTest-215802513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d5d8727-cb97-4e05-a401-3bfbab68e8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-58257b93-f7fb-4480-b32d-23b01787e9cc tempest-VolumesExtendTest-215802513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84daa309-e214-41fd-a531-cfa6194e6d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:58 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-58257b93-f7fb-4480-b32d-23b01787e9cc tempest-VolumesExtendTest-215802513 None] Volume 19dc8bd6-5076-4ff6-92a9-8125f984b4a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5', 'volume_size': 1}
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-58257b93-f7fb-4480-b32d-23b01787e9cc tempest-VolumesExtendTest-215802513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-58257b93-f7fb-4480-b32d-23b01787e9cc tempest-VolumesExtendTest-215802513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-58257b93-f7fb-4480-b32d-23b01787e9cc tempest-VolumesExtendTest-215802513 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1574904183',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19dc8bd6-5076-4ff6-92a9-8125f984b4a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e377809876f4437e8cccf021ae48e17a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:45:58Z,use_quota=True,user_id='44d6aa40c25d4ceeb26300836607fd5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-58257b93-f7fb-4480-b32d-23b01787e9cc tempest-VolumesExtendTest-215802513 None] Creating volume 19dc8bd6-5076-4ff6-92a9-8125f984b4a5 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-58257b93-f7fb-4480-b32d-23b01787e9cc tempest-VolumesExtendTest-215802513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-58257b93-f7fb-4480-b32d-23b01787e9cc tempest-VolumesExtendTest-215802513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-58257b93-f7fb-4480-b32d-23b01787e9cc tempest-VolumesExtendTest-215802513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-58257b93-f7fb-4480-b32d-23b01787e9cc tempest-VolumesExtendTest-215802513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-58257b93-f7fb-4480-b32d-23b01787e9cc tempest-VolumesExtendTest-215802513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-58257b93-f7fb-4480-b32d-23b01787e9cc tempest-VolumesExtendTest-215802513 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:45:58 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-58257b93-f7fb-4480-b32d-23b01787e9cc tempest-VolumesExtendTest-215802513 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-58257b93-f7fb-4480-b32d-23b01787e9cc tempest-VolumesExtendTest-215802513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:58 devstack sudo[89052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5 1073741824
Feb 28 04:45:58 devstack sudo[89052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9c82d98-6024-4f30-b1da-690b48b38570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ff513bc-4bc3-43f5-96da-af4908a5c7ca', 'volume_size': 1, 'image_id': '2c3eb214-ef72-4569-9890-199b020755f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2c3eb214-ef72-4569-9890-199b020755f9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c0fde1a75874ab3961d0c965899b1f4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2c3eb214-ef72-4569-9890-199b020755f9', 'created_at': datetime.datetime(2026, 2, 28, 3, 36, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 28, 3, 36, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2c3eb214-ef72-4569-9890-199b020755f9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5e40256b90>}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99d334a1-dfa2-4eba-8c3b-2b87bb195a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:58 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Volume volume-6ff513bc-4bc3-43f5-96da-af4908a5c7ca (6ff513bc-4bc3-43f5-96da-af4908a5c7ca): created successfully
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99d334a1-dfa2-4eba-8c3b-2b87bb195a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Flow 'volume_create_manager' (264c3856-57ff-4bed-9183-2e383a99a03d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:45:58 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-32044869-20f2-457d-959a-eec32985c353 tempest-VolumesImageMetadata-1402604661 None] Created volume successfully.
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d03f8f4d-1436-48ff-9b7a-b5ab74a4e9b9 tempest-GroupsTest-587314363 None] Acquiring lock "cinder-quobyte-069f65f0-193b-48a1-8ecd-86ffb224ccc1" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d03f8f4d-1436-48ff-9b7a-b5ab74a4e9b9 tempest-GroupsTest-587314363 None] Lock "cinder-quobyte-069f65f0-193b-48a1-8ecd-86ffb224ccc1" acquired by "delete_volume" :: waited 0.021s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[de66672e-66e9-4cb6-a764-fa5755456aac]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d03f8f4d-1436-48ff-9b7a-b5ab74a4e9b9 tempest-GroupsTest-587314363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-069f65f0-193b-48a1-8ecd-86ffb224ccc1 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:58 devstack sudo[89054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-069f65f0-193b-48a1-8ecd-86ffb224ccc1
Feb 28 04:45:58 devstack sudo[89054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d0259474-0003-46d1-9162-6a6c00e22930 tempest-VolumesGetTest-507974651 None] Acquiring lock "cinder-744e33ca-6729-4487-afc1-79fbd1f43005-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d0259474-0003-46d1-9162-6a6c00e22930 tempest-VolumesGetTest-507974651 None] Lock "cinder-744e33ca-6729-4487-afc1-79fbd1f43005-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d0259474-0003-46d1-9162-6a6c00e22930 tempest-VolumesGetTest-507974651 None] Acquiring lock "cinder-quobyte-744e33ca-6729-4487-afc1-79fbd1f43005" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d0259474-0003-46d1-9162-6a6c00e22930 tempest-VolumesGetTest-507974651 None] Lock "cinder-quobyte-744e33ca-6729-4487-afc1-79fbd1f43005" acquired by "delete_volume" :: waited 0.010s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[33496da8-11d4-4b3c-8f1a-472f533c9c22]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d0259474-0003-46d1-9162-6a6c00e22930 tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-744e33ca-6729-4487-afc1-79fbd1f43005 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:58 devstack sudo[89059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-744e33ca-6729-4487-afc1-79fbd1f43005
Feb 28 04:45:58 devstack sudo[89059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:58 devstack sudo[89052]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-58257b93-f7fb-4480-b32d-23b01787e9cc tempest-VolumesExtendTest-215802513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5 1073741824" returned: 0 in 0.575s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:58 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-58257b93-f7fb-4480-b32d-23b01787e9cc tempest-VolumesExtendTest-215802513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:58 devstack sudo[89061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5
Feb 28 04:45:58 devstack sudo[89061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:59 devstack sudo[89054]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d03f8f4d-1436-48ff-9b7a-b5ab74a4e9b9 tempest-GroupsTest-587314363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-069f65f0-193b-48a1-8ecd-86ffb224ccc1" returned: 0 in 0.511s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d03f8f4d-1436-48ff-9b7a-b5ab74a4e9b9 tempest-GroupsTest-587314363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-069f65f0-193b-48a1-8ecd-86ffb224ccc1 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:59 devstack sudo[89066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-069f65f0-193b-48a1-8ecd-86ffb224ccc1
Feb 28 04:45:59 devstack sudo[89066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:59 devstack sudo[89059]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d0259474-0003-46d1-9162-6a6c00e22930 tempest-VolumesGetTest-507974651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-744e33ca-6729-4487-afc1-79fbd1f43005" returned: 0 in 0.536s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d0259474-0003-46d1-9162-6a6c00e22930 tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-744e33ca-6729-4487-afc1-79fbd1f43005 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:59 devstack sudo[89061]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-58257b93-f7fb-4480-b32d-23b01787e9cc tempest-VolumesExtendTest-215802513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5" returned: 0 in 0.446s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:59 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-58257b93-f7fb-4480-b32d-23b01787e9cc tempest-VolumesExtendTest-215802513 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:45:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-58257b93-f7fb-4480-b32d-23b01787e9cc tempest-VolumesExtendTest-215802513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:59 devstack sudo[89072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-744e33ca-6729-4487-afc1-79fbd1f43005
Feb 28 04:45:59 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-58257b93-f7fb-4480-b32d-23b01787e9cc tempest-VolumesExtendTest-215802513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84daa309-e214-41fd-a531-cfa6194e6d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:59 devstack sudo[89072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:59 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-58257b93-f7fb-4480-b32d-23b01787e9cc tempest-VolumesExtendTest-215802513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1df82430-27e2-49cb-89c7-333d15be0ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:45:59 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-58257b93-f7fb-4480-b32d-23b01787e9cc tempest-VolumesExtendTest-215802513 None] Volume volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5 (19dc8bd6-5076-4ff6-92a9-8125f984b4a5): created successfully
Feb 28 04:45:59 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-58257b93-f7fb-4480-b32d-23b01787e9cc tempest-VolumesExtendTest-215802513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1df82430-27e2-49cb-89c7-333d15be0ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:45:59 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-58257b93-f7fb-4480-b32d-23b01787e9cc tempest-VolumesExtendTest-215802513 None] Flow 'volume_create_manager' (cf5073c3-235f-4aa4-adb8-88b6759d3279) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:45:59 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-58257b93-f7fb-4480-b32d-23b01787e9cc tempest-VolumesExtendTest-215802513 None] Created volume successfully.
Feb 28 04:45:59 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-fc59c4ce-550b-4bed-89e7-40d245115a75 tempest-VolumesImageMetadata-1402604661 None] Acquiring lock "cinder-6ff513bc-4bc3-43f5-96da-af4908a5c7ca-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:59 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-fc59c4ce-550b-4bed-89e7-40d245115a75 tempest-VolumesImageMetadata-1402604661 None] Lock "cinder-6ff513bc-4bc3-43f5-96da-af4908a5c7ca-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:59 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-fc59c4ce-550b-4bed-89e7-40d245115a75 tempest-VolumesImageMetadata-1402604661 None] Acquiring lock "cinder-quobyte-6ff513bc-4bc3-43f5-96da-af4908a5c7ca" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:45:59 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-fc59c4ce-550b-4bed-89e7-40d245115a75 tempest-VolumesImageMetadata-1402604661 None] Lock "cinder-quobyte-6ff513bc-4bc3-43f5-96da-af4908a5c7ca" acquired by "delete_volume" :: waited 0.011s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:45:59 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[54532346-ccb2-4695-873c-a5c2384ec0c0]: (4, 'raw') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:45:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-fc59c4ce-550b-4bed-89e7-40d245115a75 tempest-VolumesImageMetadata-1402604661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6ff513bc-4bc3-43f5-96da-af4908a5c7ca {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:59 devstack sudo[89066]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d03f8f4d-1436-48ff-9b7a-b5ab74a4e9b9 tempest-GroupsTest-587314363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-069f65f0-193b-48a1-8ecd-86ffb224ccc1" returned: 0 in 0.457s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:59 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d03f8f4d-1436-48ff-9b7a-b5ab74a4e9b9 tempest-GroupsTest-587314363 None] Lock "cinder-quobyte-069f65f0-193b-48a1-8ecd-86ffb224ccc1" released by "delete_volume" :: held 0.994s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:59 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-d03f8f4d-1436-48ff-9b7a-b5ab74a4e9b9 tempest-GroupsTest-587314363 None] Created reservations ['1d05f29c-425c-4b82-aca7-2b0f8af08cff'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:45:59 devstack sudo[89075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6ff513bc-4bc3-43f5-96da-af4908a5c7ca
Feb 28 04:45:59 devstack sudo[89075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:59 devstack cinder-volume[84248]: WARNING cinder.quota [None req-d03f8f4d-1436-48ff-9b7a-b5ab74a4e9b9 tempest-GroupsTest-587314363 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1491444396 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1491444396, it is now deprecated. Please use the default quota class for default quota.
Feb 28 04:45:59 devstack cinder-volume[84248]: WARNING cinder.quota [None req-d03f8f4d-1436-48ff-9b7a-b5ab74a4e9b9 tempest-GroupsTest-587314363 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1491444396 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1491444396, it is now deprecated. Please use the default quota class for default quota.
Feb 28 04:45:59 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-d03f8f4d-1436-48ff-9b7a-b5ab74a4e9b9 tempest-GroupsTest-587314363 None] Created reservations ['7c408999-346b-4b9b-a514-1f9d6cd62ee6', 'a47bff7a-2aaa-4744-97ed-f6d384423c02', '8ad17aa5-8ad8-46ba-bbef-7508d8697fe7', 'e7c155ea-7f8c-4250-bf8f-ec07c423167d'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:45:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d03f8f4d-1436-48ff-9b7a-b5ab74a4e9b9 tempest-GroupsTest-587314363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d03f8f4d-1436-48ff-9b7a-b5ab74a4e9b9 tempest-GroupsTest-587314363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:59 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-d03f8f4d-1436-48ff-9b7a-b5ab74a4e9b9 tempest-GroupsTest-587314363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:45:59 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-d03f8f4d-1436-48ff-9b7a-b5ab74a4e9b9 tempest-GroupsTest-587314363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:45:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d03f8f4d-1436-48ff-9b7a-b5ab74a4e9b9 tempest-GroupsTest-587314363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d03f8f4d-1436-48ff-9b7a-b5ab74a4e9b9 tempest-GroupsTest-587314363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:59 devstack sudo[89079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:45:59 devstack sudo[89079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:45:59 devstack sudo[89072]: pam_unix(sudo:session): session closed for user root
Feb 28 04:45:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d0259474-0003-46d1-9162-6a6c00e22930 tempest-VolumesGetTest-507974651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-744e33ca-6729-4487-afc1-79fbd1f43005" returned: 0 in 0.465s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:45:59 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d0259474-0003-46d1-9162-6a6c00e22930 tempest-VolumesGetTest-507974651 None] Lock "cinder-quobyte-744e33ca-6729-4487-afc1-79fbd1f43005" released by "delete_volume" :: held 1.022s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:45:59 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-d0259474-0003-46d1-9162-6a6c00e22930 tempest-VolumesGetTest-507974651 None] Created reservations ['06e1a3aa-4cd6-466e-89d8-f32622ceafcb', '0d635dd3-ff66-4c03-8a90-4e16bd653dd7', 'e0b23c7a-ada9-42b1-a46a-bcb140c74c67', '9704374d-b4fa-496d-b55a-cdd9bd2096a5'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:45:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d0259474-0003-46d1-9162-6a6c00e22930 tempest-VolumesGetTest-507974651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:45:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d0259474-0003-46d1-9162-6a6c00e22930 tempest-VolumesGetTest-507974651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:45:59 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-d0259474-0003-46d1-9162-6a6c00e22930 tempest-VolumesGetTest-507974651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:45:59 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-d0259474-0003-46d1-9162-6a6c00e22930 tempest-VolumesGetTest-507974651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:45:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d0259474-0003-46d1-9162-6a6c00e22930 tempest-VolumesGetTest-507974651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:45:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d0259474-0003-46d1-9162-6a6c00e22930 tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:45:59 devstack sudo[89081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:45:59 devstack sudo[89081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:00 devstack sudo[89075]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-fc59c4ce-550b-4bed-89e7-40d245115a75 tempest-VolumesImageMetadata-1402604661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6ff513bc-4bc3-43f5-96da-af4908a5c7ca" returned: 0 in 0.513s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-fc59c4ce-550b-4bed-89e7-40d245115a75 tempest-VolumesImageMetadata-1402604661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6ff513bc-4bc3-43f5-96da-af4908a5c7ca {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:00 devstack sudo[89085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6ff513bc-4bc3-43f5-96da-af4908a5c7ca
Feb 28 04:46:00 devstack sudo[89085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:00 devstack sudo[89079]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d03f8f4d-1436-48ff-9b7a-b5ab74a4e9b9 tempest-GroupsTest-587314363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.431s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:00 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-d03f8f4d-1436-48ff-9b7a-b5ab74a4e9b9 tempest-GroupsTest-587314363 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:46:00 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-d03f8f4d-1436-48ff-9b7a-b5ab74a4e9b9 tempest-GroupsTest-587314363 None] Delete group completed successfully.
Feb 28 04:46:00 devstack sudo[89081]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d0259474-0003-46d1-9162-6a6c00e22930 tempest-VolumesGetTest-507974651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.423s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:00 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-d0259474-0003-46d1-9162-6a6c00e22930 tempest-VolumesGetTest-507974651 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:46:00 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-d0259474-0003-46d1-9162-6a6c00e22930 tempest-VolumesGetTest-507974651 None] Deleted volume successfully.
Feb 28 04:46:00 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d0259474-0003-46d1-9162-6a6c00e22930 tempest-VolumesGetTest-507974651 None] Lock "cinder-744e33ca-6729-4487-afc1-79fbd1f43005-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-19322973-bfa9-467d-8481-c4fa477378b2 tempest-VolumesExtendTest-215802513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-19322973-bfa9-467d-8481-c4fa477378b2 tempest-VolumesExtendTest-215802513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:00 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-19322973-bfa9-467d-8481-c4fa477378b2 tempest-VolumesExtendTest-215802513 None] Creating offline snapshot 9bf257e0-158a-453a-8557-b49441d0fcc4 of volume 19dc8bd6-5076-4ff6-92a9-8125f984b4a5 {{(pid=84248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 04:46:00 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[727a48c5-dce6-409b-903a-3f5ca1c62304]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-19322973-bfa9-467d-8481-c4fa477378b2 tempest-VolumesExtendTest-215802513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:00 devstack sudo[89085]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-fc59c4ce-550b-4bed-89e7-40d245115a75 tempest-VolumesImageMetadata-1402604661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6ff513bc-4bc3-43f5-96da-af4908a5c7ca" returned: 1 in 0.487s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-fc59c4ce-550b-4bed-89e7-40d245115a75 tempest-VolumesImageMetadata-1402604661 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6ff513bc-4bc3-43f5-96da-af4908a5c7ca' failed. Not Retrying. {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 28 04:46:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-fc59c4ce-550b-4bed-89e7-40d245115a75 tempest-VolumesImageMetadata-1402604661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6ff513bc-4bc3-43f5-96da-af4908a5c7ca {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:00 devstack sudo[89093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6ff513bc-4bc3-43f5-96da-af4908a5c7ca
Feb 28 04:46:00 devstack sudo[89093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:00 devstack sudo[89092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5
Feb 28 04:46:00 devstack sudo[89092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:00 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-7e8e70b3-71df-4813-abc1-7930257f7ab6 tempest-GroupsTest-587314363 None] Created reservations ['baa793c6-5556-4c3e-8aca-7e69af242e89'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:46:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-7e8e70b3-71df-4813-abc1-7930257f7ab6 tempest-GroupsTest-587314363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-7e8e70b3-71df-4813-abc1-7930257f7ab6 tempest-GroupsTest-587314363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:00 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-7e8e70b3-71df-4813-abc1-7930257f7ab6 tempest-GroupsTest-587314363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:46:00 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-7e8e70b3-71df-4813-abc1-7930257f7ab6 tempest-GroupsTest-587314363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:46:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-7e8e70b3-71df-4813-abc1-7930257f7ab6 tempest-GroupsTest-587314363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7e8e70b3-71df-4813-abc1-7930257f7ab6 tempest-GroupsTest-587314363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:00 devstack sudo[89097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:46:00 devstack sudo[89097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:01 devstack sudo[89093]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-fc59c4ce-550b-4bed-89e7-40d245115a75 tempest-VolumesImageMetadata-1402604661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6ff513bc-4bc3-43f5-96da-af4908a5c7ca" returned: 0 in 0.400s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:01 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-7ef1fe4a-af01-434a-9df7-ac12e22d950a tempest-VolumesGetTest-507974651 None] Acquiring lock "cinder-bd6ced8f-e392-43d0-9111-db3a249fc4f5-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:01 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-fc59c4ce-550b-4bed-89e7-40d245115a75 tempest-VolumesImageMetadata-1402604661 None] Lock "cinder-quobyte-6ff513bc-4bc3-43f5-96da-af4908a5c7ca" released by "delete_volume" :: held 1.450s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:01 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-7ef1fe4a-af01-434a-9df7-ac12e22d950a tempest-VolumesGetTest-507974651 None] Lock "cinder-bd6ced8f-e392-43d0-9111-db3a249fc4f5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:01 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-fc59c4ce-550b-4bed-89e7-40d245115a75 tempest-VolumesImageMetadata-1402604661 None] Created reservations ['b89b4313-f85a-40e3-9dd5-8bcb4ef72ff5', '256234f6-6c88-4500-ad91-ef4099951e8f', 'e8907cb9-2c26-44fa-89dc-aa20e8111dea', 'c484d1c5-270d-4c87-9953-a3f3cfd4aa82'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:46:01 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-7ef1fe4a-af01-434a-9df7-ac12e22d950a tempest-VolumesGetTest-507974651 None] Acquiring lock "cinder-quobyte-bd6ced8f-e392-43d0-9111-db3a249fc4f5" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:01 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-7ef1fe4a-af01-434a-9df7-ac12e22d950a tempest-VolumesGetTest-507974651 None] Lock "cinder-quobyte-bd6ced8f-e392-43d0-9111-db3a249fc4f5" acquired by "delete_volume" :: waited 0.011s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:01 devstack sudo[89092]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-19322973-bfa9-467d-8481-c4fa477378b2 tempest-VolumesExtendTest-215802513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5" returned: 0 in 0.584s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-19322973-bfa9-467d-8481-c4fa477378b2 tempest-VolumesExtendTest-215802513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5.9bf257e0-158a-453a-8557-b49441d0fcc4 1G {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:01 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[8433bf9d-cd68-422b-9d0c-3497a8bb578b]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7ef1fe4a-af01-434a-9df7-ac12e22d950a tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:01 devstack sudo[89102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5.9bf257e0-158a-453a-8557-b49441d0fcc4 1G
Feb 28 04:46:01 devstack sudo[89102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-fc59c4ce-550b-4bed-89e7-40d245115a75 tempest-VolumesImageMetadata-1402604661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-fc59c4ce-550b-4bed-89e7-40d245115a75 tempest-VolumesImageMetadata-1402604661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:01 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-fc59c4ce-550b-4bed-89e7-40d245115a75 tempest-VolumesImageMetadata-1402604661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:46:01 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-fc59c4ce-550b-4bed-89e7-40d245115a75 tempest-VolumesImageMetadata-1402604661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:46:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-fc59c4ce-550b-4bed-89e7-40d245115a75 tempest-VolumesImageMetadata-1402604661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-fc59c4ce-550b-4bed-89e7-40d245115a75 tempest-VolumesImageMetadata-1402604661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:01 devstack sudo[89105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:46:01 devstack sudo[89105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:01 devstack sudo[89103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5
Feb 28 04:46:01 devstack sudo[89103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:01 devstack sudo[89097]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7e8e70b3-71df-4813-abc1-7930257f7ab6 tempest-GroupsTest-587314363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.449s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:01 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-7e8e70b3-71df-4813-abc1-7930257f7ab6 tempest-GroupsTest-587314363 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:46:01 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-7e8e70b3-71df-4813-abc1-7930257f7ab6 tempest-GroupsTest-587314363 None] Delete group completed successfully.
Feb 28 04:46:01 devstack sudo[89105]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-fc59c4ce-550b-4bed-89e7-40d245115a75 tempest-VolumesImageMetadata-1402604661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.420s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:01 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-fc59c4ce-550b-4bed-89e7-40d245115a75 tempest-VolumesImageMetadata-1402604661 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:46:01 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-fc59c4ce-550b-4bed-89e7-40d245115a75 tempest-VolumesImageMetadata-1402604661 None] Deleted volume successfully.
Feb 28 04:46:01 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-fc59c4ce-550b-4bed-89e7-40d245115a75 tempest-VolumesImageMetadata-1402604661 None] Lock "cinder-6ff513bc-4bc3-43f5-96da-af4908a5c7ca-delete_volume" released by "delete_volume" :: held 2.059s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:01 devstack sudo[89102]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-19322973-bfa9-467d-8481-c4fa477378b2 tempest-VolumesExtendTest-215802513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5.9bf257e0-158a-453a-8557-b49441d0fcc4 1G" returned: 0 in 0.521s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-19322973-bfa9-467d-8481-c4fa477378b2 tempest-VolumesExtendTest-215802513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5.9bf257e0-158a-453a-8557-b49441d0fcc4 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:01 devstack sudo[89103]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7ef1fe4a-af01-434a-9df7-ac12e22d950a tempest-VolumesGetTest-507974651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5" returned: 0 in 0.527s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7ef1fe4a-af01-434a-9df7-ac12e22d950a tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:01 devstack sudo[89116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5.9bf257e0-158a-453a-8557-b49441d0fcc4
Feb 28 04:46:01 devstack sudo[89116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:01 devstack sudo[89117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5
Feb 28 04:46:01 devstack sudo[89117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:02 devstack sudo[89117]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7ef1fe4a-af01-434a-9df7-ac12e22d950a tempest-VolumesGetTest-507974651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bd6ced8f-e392-43d0-9111-db3a249fc4f5" returned: 0 in 0.523s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:02 devstack sudo[89116]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-19322973-bfa9-467d-8481-c4fa477378b2 tempest-VolumesExtendTest-215802513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5.9bf257e0-158a-453a-8557-b49441d0fcc4" returned: 0 in 0.557s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:02 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-19322973-bfa9-467d-8481-c4fa477378b2 tempest-VolumesExtendTest-215802513 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5.9bf257e0-158a-453a-8557-b49441d0fcc4 is being set with open permissions: ugo+rw
Feb 28 04:46:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-19322973-bfa9-467d-8481-c4fa477378b2 tempest-VolumesExtendTest-215802513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5.9bf257e0-158a-453a-8557-b49441d0fcc4 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:02 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-7ef1fe4a-af01-434a-9df7-ac12e22d950a tempest-VolumesGetTest-507974651 None] Lock "cinder-quobyte-bd6ced8f-e392-43d0-9111-db3a249fc4f5" released by "delete_volume" :: held 1.107s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:02 devstack sudo[89124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5.9bf257e0-158a-453a-8557-b49441d0fcc4
Feb 28 04:46:02 devstack sudo[89124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:02 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-7ef1fe4a-af01-434a-9df7-ac12e22d950a tempest-VolumesGetTest-507974651 None] Created reservations ['49cc3a40-919c-4151-8fb5-509e1116e313', 'e79f722c-fa63-4d4e-bd36-3ed15e1d1492', '8b63f6d8-4454-41a5-a488-89cb4056ed28', 'a08c053e-a01e-4a83-8712-2b2503b78440'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:46:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-7ef1fe4a-af01-434a-9df7-ac12e22d950a tempest-VolumesGetTest-507974651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-7ef1fe4a-af01-434a-9df7-ac12e22d950a tempest-VolumesGetTest-507974651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:02 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-7ef1fe4a-af01-434a-9df7-ac12e22d950a tempest-VolumesGetTest-507974651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:46:02 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-7ef1fe4a-af01-434a-9df7-ac12e22d950a tempest-VolumesGetTest-507974651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:46:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-7ef1fe4a-af01-434a-9df7-ac12e22d950a tempest-VolumesGetTest-507974651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7ef1fe4a-af01-434a-9df7-ac12e22d950a tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:02 devstack sudo[89126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:46:02 devstack sudo[89126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:02 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-2be76630-eeba-4d05-8d3a-ccf82dd54b49 tempest-GroupsTest-587314363 None] Group tempest-GroupsTest-Group-1424456830: creating
Feb 28 04:46:02 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-2be76630-eeba-4d05-8d3a-ccf82dd54b49 tempest-GroupsTest-587314363 None] Group tempest-GroupsTest-Group-1424456830: created successfully
Feb 28 04:46:02 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-2be76630-eeba-4d05-8d3a-ccf82dd54b49 tempest-GroupsTest-587314363 None] Create group completed successfully.
Feb 28 04:46:02 devstack sudo[89124]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-19322973-bfa9-467d-8481-c4fa477378b2 tempest-VolumesExtendTest-215802513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5.9bf257e0-158a-453a-8557-b49441d0fcc4" returned: 0 in 0.477s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-19322973-bfa9-467d-8481-c4fa477378b2 tempest-VolumesExtendTest-215802513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:02 devstack sudo[89130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5.info
Feb 28 04:46:02 devstack sudo[89130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:02 devstack sudo[89126]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7ef1fe4a-af01-434a-9df7-ac12e22d950a tempest-VolumesGetTest-507974651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.481s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:02 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-7ef1fe4a-af01-434a-9df7-ac12e22d950a tempest-VolumesGetTest-507974651 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:46:02 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-7ef1fe4a-af01-434a-9df7-ac12e22d950a tempest-VolumesGetTest-507974651 None] Deleted volume successfully.
Feb 28 04:46:02 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-7ef1fe4a-af01-434a-9df7-ac12e22d950a tempest-VolumesGetTest-507974651 None] Lock "cinder-bd6ced8f-e392-43d0-9111-db3a249fc4f5-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:03 devstack sudo[89130]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-19322973-bfa9-467d-8481-c4fa477378b2 tempest-VolumesExtendTest-215802513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5.info" returned: 0 in 0.477s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:03 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-19322973-bfa9-467d-8481-c4fa477378b2 tempest-VolumesExtendTest-215802513 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5.info is being set with open permissions: ugo+rw
Feb 28 04:46:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-19322973-bfa9-467d-8481-c4fa477378b2 tempest-VolumesExtendTest-215802513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:03 devstack sudo[89133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5.info
Feb 28 04:46:03 devstack sudo[89133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:03 devstack sudo[89133]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-19322973-bfa9-467d-8481-c4fa477378b2 tempest-VolumesExtendTest-215802513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5.info" returned: 0 in 0.517s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-19322973-bfa9-467d-8481-c4fa477378b2 tempest-VolumesExtendTest-215802513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.195s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:03 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-19322973-bfa9-467d-8481-c4fa477378b2 tempest-VolumesExtendTest-215802513 None] Create snapshot completed successfully
Feb 28 04:46:03 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee9ae596-62a1-42ed-98ed-98c0b54d4fb9 tempest-GroupsTest-587314363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:46:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ee9ae596-62a1-42ed-98ed-98c0b54d4fb9 tempest-GroupsTest-587314363 None] Flow 'volume_create_manager' (9d231440-2f86-44bf-a985-d3ed3797e440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:46:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ee9ae596-62a1-42ed-98ed-98c0b54d4fb9 tempest-GroupsTest-587314363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (785493e8-7b69-4c87-853c-a959e669f28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ee9ae596-62a1-42ed-98ed-98c0b54d4fb9 tempest-GroupsTest-587314363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (785493e8-7b69-4c87-853c-a959e669f28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-366490313',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=191c76c6-42ef-41b0-9f7d-28a2e3ecc35a,host='devstack@QuobyteHD#QuobyteHD',id=1830435b-a024-4e95-8281-0c61f23d9116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d97dd0d71b574da1aac715b35e36a4a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:46:04Z,use_quota=True,user_id='a295ca4d8b844e75a20e7d248aacd54c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dbdcefc2-93df-4643-bc53-692eccf7d7b5),volume_type_id=dbdcefc2-93df-4643-bc53-692eccf7d7b5)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ee9ae596-62a1-42ed-98ed-98c0b54d4fb9 tempest-GroupsTest-587314363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f35bbd59-9599-4926-a290-4ff9320a35df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ee9ae596-62a1-42ed-98ed-98c0b54d4fb9 tempest-GroupsTest-587314363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f35bbd59-9599-4926-a290-4ff9320a35df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ee9ae596-62a1-42ed-98ed-98c0b54d4fb9 tempest-GroupsTest-587314363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83ffaa5d-c1b5-47e3-868a-8b4af66efbb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ee9ae596-62a1-42ed-98ed-98c0b54d4fb9 tempest-GroupsTest-587314363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83ffaa5d-c1b5-47e3-868a-8b4af66efbb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1830435b-a024-4e95-8281-0c61f23d9116', 'volume_name': 'volume-1830435b-a024-4e95-8281-0c61f23d9116', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ee9ae596-62a1-42ed-98ed-98c0b54d4fb9 tempest-GroupsTest-587314363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f6cf34f-1a0e-4f1d-aa85-9a0287c6a1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ee9ae596-62a1-42ed-98ed-98c0b54d4fb9 tempest-GroupsTest-587314363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f6cf34f-1a0e-4f1d-aa85-9a0287c6a1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ee9ae596-62a1-42ed-98ed-98c0b54d4fb9 tempest-GroupsTest-587314363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6ab74a7-4962-4bbd-8e07-bde0baf253c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:03 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-ee9ae596-62a1-42ed-98ed-98c0b54d4fb9 tempest-GroupsTest-587314363 None] Volume 1830435b-a024-4e95-8281-0c61f23d9116: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1830435b-a024-4e95-8281-0c61f23d9116', 'volume_size': 1}
Feb 28 04:46:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ee9ae596-62a1-42ed-98ed-98c0b54d4fb9 tempest-GroupsTest-587314363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ee9ae596-62a1-42ed-98ed-98c0b54d4fb9 tempest-GroupsTest-587314363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:03 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-ee9ae596-62a1-42ed-98ed-98c0b54d4fb9 tempest-GroupsTest-587314363 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=191c76c6-42ef-41b0-9f7d-28a2e3ecc35a,created_at=2026-02-28T03:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-366490313',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=191c76c6-42ef-41b0-9f7d-28a2e3ecc35a,host='devstack@QuobyteHD#QuobyteHD',id=1830435b-a024-4e95-8281-0c61f23d9116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d97dd0d71b574da1aac715b35e36a4a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:46:04Z,use_quota=True,user_id='a295ca4d8b844e75a20e7d248aacd54c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dbdcefc2-93df-4643-bc53-692eccf7d7b5),volume_type_id=dbdcefc2-93df-4643-bc53-692eccf7d7b5)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:46:03 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-ee9ae596-62a1-42ed-98ed-98c0b54d4fb9 tempest-GroupsTest-587314363 None] Creating volume 1830435b-a024-4e95-8281-0c61f23d9116 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:46:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ee9ae596-62a1-42ed-98ed-98c0b54d4fb9 tempest-GroupsTest-587314363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ee9ae596-62a1-42ed-98ed-98c0b54d4fb9 tempest-GroupsTest-587314363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:03 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-ee9ae596-62a1-42ed-98ed-98c0b54d4fb9 tempest-GroupsTest-587314363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:46:03 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-ee9ae596-62a1-42ed-98ed-98c0b54d4fb9 tempest-GroupsTest-587314363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:46:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ee9ae596-62a1-42ed-98ed-98c0b54d4fb9 tempest-GroupsTest-587314363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:03 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-ee9ae596-62a1-42ed-98ed-98c0b54d4fb9 tempest-GroupsTest-587314363 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:46:03 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-ee9ae596-62a1-42ed-98ed-98c0b54d4fb9 tempest-GroupsTest-587314363 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:46:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ee9ae596-62a1-42ed-98ed-98c0b54d4fb9 tempest-GroupsTest-587314363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1830435b-a024-4e95-8281-0c61f23d9116 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:03 devstack sudo[89136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1830435b-a024-4e95-8281-0c61f23d9116 1073741824
Feb 28 04:46:03 devstack sudo[89136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:03 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Flow 'volume_create_manager' (dc58ef26-8fe8-4523-b231-4a2a66d6f475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e45381c-f0c7-44bb-8381-8dd32b4212f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e45381c-f0c7-44bb-8381-8dd32b4212f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-651416956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24d63a8d-682b-4562-9d0a-f6c7085fb06e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='992ba50d9e4a432fbe7b2db9bbd34498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:46:04Z,use_quota=True,user_id='2247d4e35589438db75df793320c521a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2378c7d8-a704-4aaa-af6b-96b094a3dff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2378c7d8-a704-4aaa-af6b-96b094a3dff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cce3790-8998-4773-b597-10e615ab445a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG cinder.image.glance [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Creating Keystone auth plugin from conf {{(pid=84248) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3e58c58-989b-4193-83ba-0a7ca8336d38 tempest-AbsoluteLimitsTests-1778665900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b3e58c58-989b-4193-83ba-0a7ca8336d38 tempest-AbsoluteLimitsTests-1778665900 None] Flow 'volume_create_manager' (8bc4d8d4-8b98-4599-8265-d687ebf6ba26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b3e58c58-989b-4193-83ba-0a7ca8336d38 tempest-AbsoluteLimitsTests-1778665900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb421e69-fe30-4570-baaa-313e84ef0130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b3e58c58-989b-4193-83ba-0a7ca8336d38 tempest-AbsoluteLimitsTests-1778665900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb421e69-fe30-4570-baaa-313e84ef0130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2057595743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d42c96d5-5164-48a8-b332-1aebc8d10f91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e22da832fad47cdb41d79fefc19aefa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:46:04Z,use_quota=True,user_id='909e841095b9426588a948863d2bc224',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b3e58c58-989b-4193-83ba-0a7ca8336d38 tempest-AbsoluteLimitsTests-1778665900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f465822e-cf5d-43e2-82f6-35daed98d9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b3e58c58-989b-4193-83ba-0a7ca8336d38 tempest-AbsoluteLimitsTests-1778665900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f465822e-cf5d-43e2-82f6-35daed98d9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b3e58c58-989b-4193-83ba-0a7ca8336d38 tempest-AbsoluteLimitsTests-1778665900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (884e6226-2ea5-4cbe-b364-49db34e215c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b3e58c58-989b-4193-83ba-0a7ca8336d38 tempest-AbsoluteLimitsTests-1778665900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (884e6226-2ea5-4cbe-b364-49db34e215c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd42c96d5-5164-48a8-b332-1aebc8d10f91', 'volume_name': 'volume-d42c96d5-5164-48a8-b332-1aebc8d10f91', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b3e58c58-989b-4193-83ba-0a7ca8336d38 tempest-AbsoluteLimitsTests-1778665900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1045bf25-c27e-4d31-9257-e7ed786ffe72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b3e58c58-989b-4193-83ba-0a7ca8336d38 tempest-AbsoluteLimitsTests-1778665900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1045bf25-c27e-4d31-9257-e7ed786ffe72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b3e58c58-989b-4193-83ba-0a7ca8336d38 tempest-AbsoluteLimitsTests-1778665900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c1848a-89e1-4be5-a3ac-aff01a5b44e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:04 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-b3e58c58-989b-4193-83ba-0a7ca8336d38 tempest-AbsoluteLimitsTests-1778665900 None] Volume d42c96d5-5164-48a8-b332-1aebc8d10f91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d42c96d5-5164-48a8-b332-1aebc8d10f91', 'volume_size': 1}
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b3e58c58-989b-4193-83ba-0a7ca8336d38 tempest-AbsoluteLimitsTests-1778665900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cce3790-8998-4773-b597-10e615ab445a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '24d63a8d-682b-4562-9d0a-f6c7085fb06e', 'volume_name': 'volume-24d63a8d-682b-4562-9d0a-f6c7085fb06e', 'volume_size': 1, 'image_id': '2c3eb214-ef72-4569-9890-199b020755f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2c3eb214-ef72-4569-9890-199b020755f9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c0fde1a75874ab3961d0c965899b1f4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2c3eb214-ef72-4569-9890-199b020755f9', 'created_at': datetime.datetime(2026, 2, 28, 3, 36, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 28, 3, 36, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2c3eb214-ef72-4569-9890-199b020755f9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5e35e526b0>}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82dfd826-5612-4f1e-a418-e402a5f61750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82dfd826-5612-4f1e-a418-e402a5f61750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e27760c-378e-4247-87ad-b97a5b331b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:04 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Volume 24d63a8d-682b-4562-9d0a-f6c7085fb06e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-24d63a8d-682b-4562-9d0a-f6c7085fb06e', 'volume_size': 1, 'image_id': '2c3eb214-ef72-4569-9890-199b020755f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2c3eb214-ef72-4569-9890-199b020755f9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c0fde1a75874ab3961d0c965899b1f4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2c3eb214-ef72-4569-9890-199b020755f9', 'created_at': datetime.datetime(2026, 2, 28, 3, 36, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 28, 3, 36, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2c3eb214-ef72-4569-9890-199b020755f9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5e35e526b0>}
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Trying to clone 24d63a8d-682b-4562-9d0a-f6c7085fb06e from image 2c3eb214-ef72-4569-9890-199b020755f9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2c3eb214-ef72-4569-9890-199b020755f9', 'metadata': {}}]). {{(pid=84248) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Feb 28 04:46:04 devstack sudo[89136]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ee9ae596-62a1-42ed-98ed-98c0b54d4fb9 tempest-GroupsTest-587314363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1830435b-a024-4e95-8281-0c61f23d9116 1073741824" returned: 0 in 0.598s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ee9ae596-62a1-42ed-98ed-98c0b54d4fb9 tempest-GroupsTest-587314363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1830435b-a024-4e95-8281-0c61f23d9116 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG cinder.image.image_utils [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_laidbl7edevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84248) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Feb 28 04:46:04 devstack cinder-volume[84248]: INFO cinder.image.image_utils [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Image download 20.69 MB at 20.69 MB/s
Feb 28 04:46:04 devstack sudo[89142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1830435b-a024-4e95-8281-0c61f23d9116
Feb 28 04:46:04 devstack sudo[89142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[1675f6b7-2588-4c53-8831-cbdded56b63e]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_laidbl7edevstack@QuobyteHD {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:04 devstack sudo[89144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_laidbl7edevstack@QuobyteHD
Feb 28 04:46:04 devstack sudo[89144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-af9305c0-a4f0-45ca-a7eb-9d7a852d9a7d tempest-VolumesExtendTest-215802513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:04 devstack sudo[89142]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ee9ae596-62a1-42ed-98ed-98c0b54d4fb9 tempest-GroupsTest-587314363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1830435b-a024-4e95-8281-0c61f23d9116" returned: 0 in 0.406s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-ee9ae596-62a1-42ed-98ed-98c0b54d4fb9 tempest-GroupsTest-587314363 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ee9ae596-62a1-42ed-98ed-98c0b54d4fb9 tempest-GroupsTest-587314363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b3e58c58-989b-4193-83ba-0a7ca8336d38 tempest-AbsoluteLimitsTests-1778665900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.678s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-b3e58c58-989b-4193-83ba-0a7ca8336d38 tempest-AbsoluteLimitsTests-1778665900 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2057595743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d42c96d5-5164-48a8-b332-1aebc8d10f91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e22da832fad47cdb41d79fefc19aefa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:46:04Z,use_quota=True,user_id='909e841095b9426588a948863d2bc224',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-b3e58c58-989b-4193-83ba-0a7ca8336d38 tempest-AbsoluteLimitsTests-1778665900 None] Creating volume d42c96d5-5164-48a8-b332-1aebc8d10f91 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b3e58c58-989b-4193-83ba-0a7ca8336d38 tempest-AbsoluteLimitsTests-1778665900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b3e58c58-989b-4193-83ba-0a7ca8336d38 tempest-AbsoluteLimitsTests-1778665900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-b3e58c58-989b-4193-83ba-0a7ca8336d38 tempest-AbsoluteLimitsTests-1778665900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-b3e58c58-989b-4193-83ba-0a7ca8336d38 tempest-AbsoluteLimitsTests-1778665900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b3e58c58-989b-4193-83ba-0a7ca8336d38 tempest-AbsoluteLimitsTests-1778665900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-b3e58c58-989b-4193-83ba-0a7ca8336d38 tempest-AbsoluteLimitsTests-1778665900 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:46:04 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-b3e58c58-989b-4193-83ba-0a7ca8336d38 tempest-AbsoluteLimitsTests-1778665900 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b3e58c58-989b-4193-83ba-0a7ca8336d38 tempest-AbsoluteLimitsTests-1778665900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-d42c96d5-5164-48a8-b332-1aebc8d10f91 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG dbcounter [-] [84248] Writing DB stats cinder:SELECT=220,cinder:INSERT=80,cinder:UPDATE=255,cinder:DELETE=22 {{(pid=84248) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 04:46:04 devstack sudo[89147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-d42c96d5-5164-48a8-b332-1aebc8d10f91 1073741824
Feb 28 04:46:04 devstack sudo[89147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ee9ae596-62a1-42ed-98ed-98c0b54d4fb9 tempest-GroupsTest-587314363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6ab74a7-4962-4bbd-8e07-bde0baf253c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1830435b-a024-4e95-8281-0c61f23d9116', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ee9ae596-62a1-42ed-98ed-98c0b54d4fb9 tempest-GroupsTest-587314363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64a4c3f1-cd2c-4e59-a2af-53991163155d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG dbcounter [-] [84248] Writing DB stats cinder:UPDATE=291,cinder:SELECT=195,cinder:INSERT=73,cinder:DELETE=21 {{(pid=84248) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 04:46:04 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-ee9ae596-62a1-42ed-98ed-98c0b54d4fb9 tempest-GroupsTest-587314363 None] Volume volume-1830435b-a024-4e95-8281-0c61f23d9116 (1830435b-a024-4e95-8281-0c61f23d9116): created successfully
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ee9ae596-62a1-42ed-98ed-98c0b54d4fb9 tempest-GroupsTest-587314363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64a4c3f1-cd2c-4e59-a2af-53991163155d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ee9ae596-62a1-42ed-98ed-98c0b54d4fb9 tempest-GroupsTest-587314363 None] Flow 'volume_create_manager' (9d231440-2f86-44bf-a985-d3ed3797e440) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:46:04 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-ee9ae596-62a1-42ed-98ed-98c0b54d4fb9 tempest-GroupsTest-587314363 None] Created volume successfully.
Feb 28 04:46:05 devstack sudo[89144]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_laidbl7edevstack@QuobyteHD" returned: 0 in 0.512s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:05 devstack cinder-volume[84248]: DEBUG cinder.image.image_utils [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Temporary image 2c3eb214-ef72-4569-9890-199b020755f9 is fetched for user 2247d4e35589438db75df793320c521a. {{(pid=84248) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Feb 28 04:46:05 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf0ee1e-1e4b-40bd-b3fd-ba49bacb0ddf]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_laidbl7edevstack@QuobyteHD {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:05 devstack sudo[89152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_laidbl7edevstack@QuobyteHD
Feb 28 04:46:05 devstack sudo[89152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:05 devstack sudo[89147]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b3e58c58-989b-4193-83ba-0a7ca8336d38 tempest-AbsoluteLimitsTests-1778665900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-d42c96d5-5164-48a8-b332-1aebc8d10f91 1073741824" returned: 0 in 0.480s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b3e58c58-989b-4193-83ba-0a7ca8336d38 tempest-AbsoluteLimitsTests-1778665900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-d42c96d5-5164-48a8-b332-1aebc8d10f91 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:05 devstack sudo[89157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-d42c96d5-5164-48a8-b332-1aebc8d10f91
Feb 28 04:46:05 devstack sudo[89157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:05 devstack sudo[89152]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_laidbl7edevstack@QuobyteHD" returned: 0 in 0.448s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:05 devstack sudo[89157]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b3e58c58-989b-4193-83ba-0a7ca8336d38 tempest-AbsoluteLimitsTests-1778665900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-d42c96d5-5164-48a8-b332-1aebc8d10f91" returned: 0 in 0.390s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:05 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-b3e58c58-989b-4193-83ba-0a7ca8336d38 tempest-AbsoluteLimitsTests-1778665900 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:46:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b3e58c58-989b-4193-83ba-0a7ca8336d38 tempest-AbsoluteLimitsTests-1778665900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-af9305c0-a4f0-45ca-a7eb-9d7a852d9a7d tempest-VolumesExtendTest-215802513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.928s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:05 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b3e58c58-989b-4193-83ba-0a7ca8336d38 tempest-AbsoluteLimitsTests-1778665900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c1848a-89e1-4be5-a3ac-aff01a5b44e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d42c96d5-5164-48a8-b332-1aebc8d10f91', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:05 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b3e58c58-989b-4193-83ba-0a7ca8336d38 tempest-AbsoluteLimitsTests-1778665900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c56b51d-13bc-4f80-bee4-1ac13f22c909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:05 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc7dfcd-8661-4df7-b68e-b4135dccab1c]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-af9305c0-a4f0-45ca-a7eb-9d7a852d9a7d tempest-VolumesExtendTest-215802513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:05 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-b3e58c58-989b-4193-83ba-0a7ca8336d38 tempest-AbsoluteLimitsTests-1778665900 None] Volume volume-d42c96d5-5164-48a8-b332-1aebc8d10f91 (d42c96d5-5164-48a8-b332-1aebc8d10f91): created successfully
Feb 28 04:46:05 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b3e58c58-989b-4193-83ba-0a7ca8336d38 tempest-AbsoluteLimitsTests-1778665900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c56b51d-13bc-4f80-bee4-1ac13f22c909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:05 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b3e58c58-989b-4193-83ba-0a7ca8336d38 tempest-AbsoluteLimitsTests-1778665900 None] Flow 'volume_create_manager' (8bc4d8d4-8b98-4599-8265-d687ebf6ba26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:46:05 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-b3e58c58-989b-4193-83ba-0a7ca8336d38 tempest-AbsoluteLimitsTests-1778665900 None] Created volume successfully.
Feb 28 04:46:05 devstack sudo[89163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5
Feb 28 04:46:05 devstack sudo[89163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:06 devstack sudo[89163]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-af9305c0-a4f0-45ca-a7eb-9d7a852d9a7d tempest-VolumesExtendTest-215802513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5" returned: 0 in 0.522s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-af9305c0-a4f0-45ca-a7eb-9d7a852d9a7d tempest-VolumesExtendTest-215802513 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5.9bf257e0-158a-453a-8557-b49441d0fcc4 2G {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:06 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-a27320b3-e717-4cc0-9c0b-5cd1bfc2b361 tempest-GroupsTest-587314363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:46:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a27320b3-e717-4cc0-9c0b-5cd1bfc2b361 tempest-GroupsTest-587314363 None] Flow 'volume_create_manager' (c14fa145-0887-41df-8263-ea3a903da87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:46:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a27320b3-e717-4cc0-9c0b-5cd1bfc2b361 tempest-GroupsTest-587314363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89b532cf-643f-41ba-bde1-8d62f4b4646c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a27320b3-e717-4cc0-9c0b-5cd1bfc2b361 tempest-GroupsTest-587314363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89b532cf-643f-41ba-bde1-8d62f4b4646c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:46:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1472460636',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=191c76c6-42ef-41b0-9f7d-28a2e3ecc35a,host='devstack@QuobyteHD#QuobyteHD',id=b60b7440-229d-491c-94ec-c1e41f27b589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d97dd0d71b574da1aac715b35e36a4a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:46:06Z,use_quota=True,user_id='a295ca4d8b844e75a20e7d248aacd54c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dbdcefc2-93df-4643-bc53-692eccf7d7b5),volume_type_id=dbdcefc2-93df-4643-bc53-692eccf7d7b5)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a27320b3-e717-4cc0-9c0b-5cd1bfc2b361 tempest-GroupsTest-587314363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f328cdbb-d0c2-42df-8e82-a7a05c707f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a27320b3-e717-4cc0-9c0b-5cd1bfc2b361 tempest-GroupsTest-587314363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f328cdbb-d0c2-42df-8e82-a7a05c707f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a27320b3-e717-4cc0-9c0b-5cd1bfc2b361 tempest-GroupsTest-587314363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08d8de23-fea4-4dbf-b825-8d03b9d39b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a27320b3-e717-4cc0-9c0b-5cd1bfc2b361 tempest-GroupsTest-587314363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08d8de23-fea4-4dbf-b825-8d03b9d39b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b60b7440-229d-491c-94ec-c1e41f27b589', 'volume_name': 'volume-b60b7440-229d-491c-94ec-c1e41f27b589', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a27320b3-e717-4cc0-9c0b-5cd1bfc2b361 tempest-GroupsTest-587314363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9504f63c-76e8-480c-9da4-cdf0d9f2f1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a27320b3-e717-4cc0-9c0b-5cd1bfc2b361 tempest-GroupsTest-587314363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9504f63c-76e8-480c-9da4-cdf0d9f2f1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a27320b3-e717-4cc0-9c0b-5cd1bfc2b361 tempest-GroupsTest-587314363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69f59e8b-6b14-4cff-81d1-2f9b2b3852d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:06 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-a27320b3-e717-4cc0-9c0b-5cd1bfc2b361 tempest-GroupsTest-587314363 None] Volume b60b7440-229d-491c-94ec-c1e41f27b589: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b60b7440-229d-491c-94ec-c1e41f27b589', 'volume_size': 1}
Feb 28 04:46:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a27320b3-e717-4cc0-9c0b-5cd1bfc2b361 tempest-GroupsTest-587314363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:06 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-cfdbce95-24d0-473f-9736-46d27b5c244c tempest-AbsoluteLimitsTests-1778665900 None] Acquiring lock "cinder-d42c96d5-5164-48a8-b332-1aebc8d10f91-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-af9305c0-a4f0-45ca-a7eb-9d7a852d9a7d tempest-VolumesExtendTest-215802513 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5.9bf257e0-158a-453a-8557-b49441d0fcc4 2G" returned: 0 in 0.124s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-af9305c0-a4f0-45ca-a7eb-9d7a852d9a7d tempest-VolumesExtendTest-215802513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.673s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.943s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:06 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-651416956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24d63a8d-682b-4562-9d0a-f6c7085fb06e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='992ba50d9e4a432fbe7b2db9bbd34498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:46:04Z,use_quota=True,user_id='2247d4e35589438db75df793320c521a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:46:06 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Creating volume 24d63a8d-682b-4562-9d0a-f6c7085fb06e {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:46:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:06 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:46:06 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:46:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:06 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:46:06 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:46:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-24d63a8d-682b-4562-9d0a-f6c7085fb06e 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:06 devstack sudo[89171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-24d63a8d-682b-4562-9d0a-f6c7085fb06e 1073741824
Feb 28 04:46:06 devstack sudo[89171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:06 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-cfdbce95-24d0-473f-9736-46d27b5c244c tempest-AbsoluteLimitsTests-1778665900 None] Lock "cinder-d42c96d5-5164-48a8-b332-1aebc8d10f91-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:06 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-af9305c0-a4f0-45ca-a7eb-9d7a852d9a7d tempest-VolumesExtendTest-215802513 None] Extend volume completed successfully.
Feb 28 04:46:06 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-cfdbce95-24d0-473f-9736-46d27b5c244c tempest-AbsoluteLimitsTests-1778665900 None] Acquiring lock "cinder-quobyte-d42c96d5-5164-48a8-b332-1aebc8d10f91" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:06 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-cfdbce95-24d0-473f-9736-46d27b5c244c tempest-AbsoluteLimitsTests-1778665900 None] Lock "cinder-quobyte-d42c96d5-5164-48a8-b332-1aebc8d10f91" acquired by "delete_volume" :: waited 0.007s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:06 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc709ca-4af0-4dac-8c4d-0817239169bb]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-cfdbce95-24d0-473f-9736-46d27b5c244c tempest-AbsoluteLimitsTests-1778665900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-d42c96d5-5164-48a8-b332-1aebc8d10f91 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:06 devstack sudo[89173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-d42c96d5-5164-48a8-b332-1aebc8d10f91
Feb 28 04:46:06 devstack sudo[89173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:06 devstack sudo[89171]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-24d63a8d-682b-4562-9d0a-f6c7085fb06e 1073741824" returned: 0 in 0.474s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-24d63a8d-682b-4562-9d0a-f6c7085fb06e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:07 devstack sudo[89180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-24d63a8d-682b-4562-9d0a-f6c7085fb06e
Feb 28 04:46:07 devstack sudo[89180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:07 devstack sudo[89173]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-cfdbce95-24d0-473f-9736-46d27b5c244c tempest-AbsoluteLimitsTests-1778665900 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-d42c96d5-5164-48a8-b332-1aebc8d10f91" returned: 0 in 0.535s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-cfdbce95-24d0-473f-9736-46d27b5c244c tempest-AbsoluteLimitsTests-1778665900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-d42c96d5-5164-48a8-b332-1aebc8d10f91 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:07 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-440a6360-2df4-49dd-a791-7e07e9825215 tempest-VolumesExtendTest-215802513 None] Acquiring lock "cinder-9bf257e0-158a-453a-8557-b49441d0fcc4-delete_snapshot" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:07 devstack sudo[89183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-d42c96d5-5164-48a8-b332-1aebc8d10f91
Feb 28 04:46:07 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-440a6360-2df4-49dd-a791-7e07e9825215 tempest-VolumesExtendTest-215802513 None] Lock "cinder-9bf257e0-158a-453a-8557-b49441d0fcc4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:07 devstack sudo[89183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:07 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-440a6360-2df4-49dd-a791-7e07e9825215 tempest-VolumesExtendTest-215802513 None] Acquiring lock "cinder-quobyte-19dc8bd6-5076-4ff6-92a9-8125f984b4a5" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:07 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-440a6360-2df4-49dd-a791-7e07e9825215 tempest-VolumesExtendTest-215802513 None] Lock "cinder-quobyte-19dc8bd6-5076-4ff6-92a9-8125f984b4a5" acquired by "delete_snapshot" :: waited 0.008s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:07 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-440a6360-2df4-49dd-a791-7e07e9825215 tempest-VolumesExtendTest-215802513 None] Acquiring lock "cinder-quobyte-9bf257e0-158a-453a-8557-b49441d0fcc4" by "_delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:07 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-440a6360-2df4-49dd-a791-7e07e9825215 tempest-VolumesExtendTest-215802513 None] Lock "cinder-quobyte-9bf257e0-158a-453a-8557-b49441d0fcc4" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:07 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-440a6360-2df4-49dd-a791-7e07e9825215 tempest-VolumesExtendTest-215802513 None] Deleting offline snapshot 9bf257e0-158a-453a-8557-b49441d0fcc4 of volume 19dc8bd6-5076-4ff6-92a9-8125f984b4a5 {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 04:46:07 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-440a6360-2df4-49dd-a791-7e07e9825215 tempest-VolumesExtendTest-215802513 None] snapshot_file for this snap is: volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5.9bf257e0-158a-453a-8557-b49441d0fcc4 {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 04:46:07 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[124bdb32-7902-4050-9bf3-4ad25df1f310]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-440a6360-2df4-49dd-a791-7e07e9825215 tempest-VolumesExtendTest-215802513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5.9bf257e0-158a-453a-8557-b49441d0fcc4 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:07 devstack sudo[89185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5.9bf257e0-158a-453a-8557-b49441d0fcc4
Feb 28 04:46:07 devstack sudo[89185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:07 devstack sudo[89180]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-24d63a8d-682b-4562-9d0a-f6c7085fb06e" returned: 0 in 0.453s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:07 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:46:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a27320b3-e717-4cc0-9c0b-5cd1bfc2b361 tempest-GroupsTest-587314363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.975s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:07 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-a27320b3-e717-4cc0-9c0b-5cd1bfc2b361 tempest-GroupsTest-587314363 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=191c76c6-42ef-41b0-9f7d-28a2e3ecc35a,created_at=2026-02-28T03:46:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1472460636',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=191c76c6-42ef-41b0-9f7d-28a2e3ecc35a,host='devstack@QuobyteHD#QuobyteHD',id=b60b7440-229d-491c-94ec-c1e41f27b589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d97dd0d71b574da1aac715b35e36a4a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:46:06Z,use_quota=True,user_id='a295ca4d8b844e75a20e7d248aacd54c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dbdcefc2-93df-4643-bc53-692eccf7d7b5),volume_type_id=dbdcefc2-93df-4643-bc53-692eccf7d7b5)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:46:07 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-a27320b3-e717-4cc0-9c0b-5cd1bfc2b361 tempest-GroupsTest-587314363 None] Creating volume b60b7440-229d-491c-94ec-c1e41f27b589 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:46:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a27320b3-e717-4cc0-9c0b-5cd1bfc2b361 tempest-GroupsTest-587314363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a27320b3-e717-4cc0-9c0b-5cd1bfc2b361 tempest-GroupsTest-587314363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:07 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-a27320b3-e717-4cc0-9c0b-5cd1bfc2b361 tempest-GroupsTest-587314363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:46:07 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-a27320b3-e717-4cc0-9c0b-5cd1bfc2b361 tempest-GroupsTest-587314363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:46:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a27320b3-e717-4cc0-9c0b-5cd1bfc2b361 tempest-GroupsTest-587314363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:07 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-a27320b3-e717-4cc0-9c0b-5cd1bfc2b361 tempest-GroupsTest-587314363 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:46:07 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-a27320b3-e717-4cc0-9c0b-5cd1bfc2b361 tempest-GroupsTest-587314363 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:46:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a27320b3-e717-4cc0-9c0b-5cd1bfc2b361 tempest-GroupsTest-587314363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b60b7440-229d-491c-94ec-c1e41f27b589 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:07 devstack cinder-volume[84248]: DEBUG cinder.volume.volume_utils [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Attempting download of 2c3eb214-ef72-4569-9890-199b020755f9 ((None, [{'url': 'file:///opt/stack/data/glance/images/2c3eb214-ef72-4569-9890-199b020755f9', 'metadata': {}}])) to volume 24d63a8d-682b-4562-9d0a-f6c7085fb06e. {{(pid=84248) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Feb 28 04:46:07 devstack sudo[89189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b60b7440-229d-491c-94ec-c1e41f27b589 1073741824
Feb 28 04:46:07 devstack sudo[89189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:07 devstack sudo[89183]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:07 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e61f34-8dd1-491e-9cde-7e06585aefd5]: (4, 'raw') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2c3eb214-ef72-4569-9890-199b020755f9_hhbvg9tw {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-cfdbce95-24d0-473f-9736-46d27b5c244c tempest-AbsoluteLimitsTests-1778665900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-d42c96d5-5164-48a8-b332-1aebc8d10f91" returned: 0 in 0.439s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:07 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-cfdbce95-24d0-473f-9736-46d27b5c244c tempest-AbsoluteLimitsTests-1778665900 None] Lock "cinder-quobyte-d42c96d5-5164-48a8-b332-1aebc8d10f91" released by "delete_volume" :: held 1.006s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:07 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-cfdbce95-24d0-473f-9736-46d27b5c244c tempest-AbsoluteLimitsTests-1778665900 None] Created reservations ['1d574ced-2b1a-4839-8ef6-abc5f439d891', 'e2ac4ced-9875-4b8d-819e-49a6da851a31', '2e6cb572-991c-4026-8319-9aaba217a874', '15dcb986-9ab0-4d18-9cad-d7d86dbf71cb'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:46:07 devstack sudo[89191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2c3eb214-ef72-4569-9890-199b020755f9_hhbvg9tw
Feb 28 04:46:07 devstack sudo[89191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-cfdbce95-24d0-473f-9736-46d27b5c244c tempest-AbsoluteLimitsTests-1778665900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-cfdbce95-24d0-473f-9736-46d27b5c244c tempest-AbsoluteLimitsTests-1778665900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:07 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-cfdbce95-24d0-473f-9736-46d27b5c244c tempest-AbsoluteLimitsTests-1778665900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:46:07 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-cfdbce95-24d0-473f-9736-46d27b5c244c tempest-AbsoluteLimitsTests-1778665900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:46:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-cfdbce95-24d0-473f-9736-46d27b5c244c tempest-AbsoluteLimitsTests-1778665900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-cfdbce95-24d0-473f-9736-46d27b5c244c tempest-AbsoluteLimitsTests-1778665900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:07 devstack sudo[89196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:46:07 devstack sudo[89196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:07 devstack sudo[89185]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-440a6360-2df4-49dd-a791-7e07e9825215 tempest-VolumesExtendTest-215802513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5.9bf257e0-158a-453a-8557-b49441d0fcc4" returned: 0 in 0.520s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:07 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-440a6360-2df4-49dd-a791-7e07e9825215 tempest-VolumesExtendTest-215802513 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:46:07 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a75801-9668-4340-872b-fdaf185714d9]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-440a6360-2df4-49dd-a791-7e07e9825215 tempest-VolumesExtendTest-215802513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:07 devstack sudo[89198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5
Feb 28 04:46:07 devstack sudo[89198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:07 devstack sudo[89189]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a27320b3-e717-4cc0-9c0b-5cd1bfc2b361 tempest-GroupsTest-587314363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b60b7440-229d-491c-94ec-c1e41f27b589 1073741824" returned: 0 in 0.528s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a27320b3-e717-4cc0-9c0b-5cd1bfc2b361 tempest-GroupsTest-587314363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b60b7440-229d-491c-94ec-c1e41f27b589 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:08 devstack sudo[89206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b60b7440-229d-491c-94ec-c1e41f27b589
Feb 28 04:46:08 devstack sudo[89206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:08 devstack sudo[89191]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2c3eb214-ef72-4569-9890-199b020755f9_hhbvg9tw" returned: 0 in 0.514s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c3eb214-ef72-4569-9890-199b020755f9_hhbvg9tw {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:08 devstack sudo[89196]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-cfdbce95-24d0-473f-9736-46d27b5c244c tempest-AbsoluteLimitsTests-1778665900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.426s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:08 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-cfdbce95-24d0-473f-9736-46d27b5c244c tempest-AbsoluteLimitsTests-1778665900 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:46:08 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-cfdbce95-24d0-473f-9736-46d27b5c244c tempest-AbsoluteLimitsTests-1778665900 None] Deleted volume successfully.
Feb 28 04:46:08 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-cfdbce95-24d0-473f-9736-46d27b5c244c tempest-AbsoluteLimitsTests-1778665900 None] Lock "cinder-d42c96d5-5164-48a8-b332-1aebc8d10f91-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:08 devstack sudo[89208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c3eb214-ef72-4569-9890-199b020755f9_hhbvg9tw
Feb 28 04:46:08 devstack sudo[89208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:08 devstack sudo[89198]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-440a6360-2df4-49dd-a791-7e07e9825215 tempest-VolumesExtendTest-215802513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5" returned: 0 in 0.540s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-440a6360-2df4-49dd-a791-7e07e9825215 tempest-VolumesExtendTest-215802513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5.9bf257e0-158a-453a-8557-b49441d0fcc4 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:08 devstack sudo[89213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5.9bf257e0-158a-453a-8557-b49441d0fcc4
Feb 28 04:46:08 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:08 devstack sudo[89206]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a27320b3-e717-4cc0-9c0b-5cd1bfc2b361 tempest-GroupsTest-587314363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b60b7440-229d-491c-94ec-c1e41f27b589" returned: 0 in 0.414s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:08 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-a27320b3-e717-4cc0-9c0b-5cd1bfc2b361 tempest-GroupsTest-587314363 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:46:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a27320b3-e717-4cc0-9c0b-5cd1bfc2b361 tempest-GroupsTest-587314363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:08 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a27320b3-e717-4cc0-9c0b-5cd1bfc2b361 tempest-GroupsTest-587314363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69f59e8b-6b14-4cff-81d1-2f9b2b3852d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b60b7440-229d-491c-94ec-c1e41f27b589', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:08 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a27320b3-e717-4cc0-9c0b-5cd1bfc2b361 tempest-GroupsTest-587314363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efa768da-2463-4084-8364-11c7cc5dbf88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:08 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-a27320b3-e717-4cc0-9c0b-5cd1bfc2b361 tempest-GroupsTest-587314363 None] Volume volume-b60b7440-229d-491c-94ec-c1e41f27b589 (b60b7440-229d-491c-94ec-c1e41f27b589): created successfully
Feb 28 04:46:08 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a27320b3-e717-4cc0-9c0b-5cd1bfc2b361 tempest-GroupsTest-587314363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efa768da-2463-4084-8364-11c7cc5dbf88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:08 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a27320b3-e717-4cc0-9c0b-5cd1bfc2b361 tempest-GroupsTest-587314363 None] Flow 'volume_create_manager' (c14fa145-0887-41df-8263-ea3a903da87f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:46:08 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-a27320b3-e717-4cc0-9c0b-5cd1bfc2b361 tempest-GroupsTest-587314363 None] Created volume successfully.
Feb 28 04:46:08 devstack sudo[89208]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c3eb214-ef72-4569-9890-199b020755f9_hhbvg9tw" returned: 1 in 0.461s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c3eb214-ef72-4569-9890-199b020755f9_hhbvg9tw' failed. Not Retrying. {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 28 04:46:08 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd0ddd0-0aae-4c01-975b-e0b1e8558028]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_laidbl7edevstack@QuobyteHD {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:08 devstack sudo[89218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_laidbl7edevstack@QuobyteHD
Feb 28 04:46:08 devstack sudo[89218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:08 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-440a6360-2df4-49dd-a791-7e07e9825215 tempest-VolumesExtendTest-215802513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5.9bf257e0-158a-453a-8557-b49441d0fcc4" returned: 0 in 0.502s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-440a6360-2df4-49dd-a791-7e07e9825215 tempest-VolumesExtendTest-215802513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5.9bf257e0-158a-453a-8557-b49441d0fcc4 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:08 devstack sudo[89223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5.9bf257e0-158a-453a-8557-b49441d0fcc4
Feb 28 04:46:08 devstack sudo[89223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:09 devstack sudo[89218]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:09 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_laidbl7edevstack@QuobyteHD" returned: 0 in 0.489s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:09 devstack cinder-volume[84248]: DEBUG cinder.image.image_utils [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] 2c3eb214-ef72-4569-9890-199b020755f9 was qcow2, converting to raw {{(pid=84248) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Feb 28 04:46:09 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_laidbl7edevstack@QuobyteHD /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-24d63a8d-682b-4562-9d0a-f6c7085fb06e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:09 devstack sudo[89228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_laidbl7edevstack@QuobyteHD /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-24d63a8d-682b-4562-9d0a-f6c7085fb06e
Feb 28 04:46:09 devstack sudo[89228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:09 devstack sudo[89223]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:09 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-440a6360-2df4-49dd-a791-7e07e9825215 tempest-VolumesExtendTest-215802513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5.9bf257e0-158a-453a-8557-b49441d0fcc4" returned: 0 in 0.462s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:09 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-440a6360-2df4-49dd-a791-7e07e9825215 tempest-VolumesExtendTest-215802513 None] Lock "cinder-quobyte-9bf257e0-158a-453a-8557-b49441d0fcc4" released by "_delete_snapshot" :: held 2.082s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:09 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-440a6360-2df4-49dd-a791-7e07e9825215 tempest-VolumesExtendTest-215802513 None] Lock "cinder-quobyte-19dc8bd6-5076-4ff6-92a9-8125f984b4a5" released by "delete_snapshot" :: held 2.094s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:09 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-440a6360-2df4-49dd-a791-7e07e9825215 tempest-VolumesExtendTest-215802513 None] Created reservations ['9d7ad463-631e-4708-94e8-685290099852', '5059b724-f7b4-4c40-ac1f-6fa9b6f97ab3', '9a2ca01f-28db-4e3f-8e42-ba30f12f42b9', '63864d31-9a8f-42a1-aa82-f63c40a41c92'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:46:09 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-440a6360-2df4-49dd-a791-7e07e9825215 tempest-VolumesExtendTest-215802513 None] Delete snapshot completed successfully.
Feb 28 04:46:09 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-440a6360-2df4-49dd-a791-7e07e9825215 tempest-VolumesExtendTest-215802513 None] Lock "cinder-9bf257e0-158a-453a-8557-b49441d0fcc4-delete_snapshot" released by "delete_snapshot" :: held 2.186s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:09 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-39ee0c69-4fc2-46cf-a56e-46c4b22ff672 tempest-GroupsTest-587314363 None] Update group completed successfully.
Feb 28 04:46:10 devstack sudo[89228]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_laidbl7edevstack@QuobyteHD /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-24d63a8d-682b-4562-9d0a-f6c7085fb06e" returned: 0 in 1.029s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:10 devstack cinder-volume[84248]: DEBUG cinder.image.image_utils [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2c3eb214-ef72-4569-9890-199b020755f9_laidbl7edevstack@QuobyteHD, size 112.00 MB, duration 1.03 sec, destination /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-24d63a8d-682b-4562-9d0a-f6c7085fb06e {{(pid=84248) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 28 04:46:10 devstack cinder-volume[84248]: INFO cinder.image.image_utils [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Converted 112.00 MB image at 108.70 MB/s
Feb 28 04:46:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-24d63a8d-682b-4562-9d0a-f6c7085fb06e 1G {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:10 devstack sudo[89239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-24d63a8d-682b-4562-9d0a-f6c7085fb06e 1G
Feb 28 04:46:10 devstack sudo[89239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:10 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-323f01e5-342c-4b1f-a65b-f54f6fcc4477 tempest-VolumesExtendTest-215802513 None] Acquiring lock "cinder-19dc8bd6-5076-4ff6-92a9-8125f984b4a5-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:10 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-323f01e5-342c-4b1f-a65b-f54f6fcc4477 tempest-VolumesExtendTest-215802513 None] Lock "cinder-19dc8bd6-5076-4ff6-92a9-8125f984b4a5-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:10 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-323f01e5-342c-4b1f-a65b-f54f6fcc4477 tempest-VolumesExtendTest-215802513 None] Acquiring lock "cinder-quobyte-19dc8bd6-5076-4ff6-92a9-8125f984b4a5" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:10 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-323f01e5-342c-4b1f-a65b-f54f6fcc4477 tempest-VolumesExtendTest-215802513 None] Lock "cinder-quobyte-19dc8bd6-5076-4ff6-92a9-8125f984b4a5" acquired by "delete_volume" :: waited 0.021s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:10 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b61a50-f0ed-478f-84da-08b6b613e322]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-323f01e5-342c-4b1f-a65b-f54f6fcc4477 tempest-VolumesExtendTest-215802513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:10 devstack sudo[89241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5
Feb 28 04:46:10 devstack sudo[89241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:10 devstack sudo[89239]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-24d63a8d-682b-4562-9d0a-f6c7085fb06e 1G" returned: 0 in 0.542s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:10 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1289c4a-a53d-449a-9a5d-99000e03dd8f]: (4, 'raw') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-24d63a8d-682b-4562-9d0a-f6c7085fb06e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:10 devstack sudo[89246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-24d63a8d-682b-4562-9d0a-f6c7085fb06e
Feb 28 04:46:10 devstack sudo[89246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:10 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-0794e230-4e5a-4a48-8a6e-a3142314d9f6 tempest-GroupsTest-587314363 None] Update group completed successfully.
Feb 28 04:46:10 devstack sudo[89241]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-323f01e5-342c-4b1f-a65b-f54f6fcc4477 tempest-VolumesExtendTest-215802513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5" returned: 0 in 0.581s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-323f01e5-342c-4b1f-a65b-f54f6fcc4477 tempest-VolumesExtendTest-215802513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:11 devstack sudo[89251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5
Feb 28 04:46:11 devstack sudo[89251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:11 devstack sudo[89246]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-24d63a8d-682b-4562-9d0a-f6c7085fb06e" returned: 0 in 0.543s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-24d63a8d-682b-4562-9d0a-f6c7085fb06e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:11 devstack sudo[89255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-24d63a8d-682b-4562-9d0a-f6c7085fb06e
Feb 28 04:46:11 devstack sudo[89255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:11 devstack sudo[89251]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-323f01e5-342c-4b1f-a65b-f54f6fcc4477 tempest-VolumesExtendTest-215802513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19dc8bd6-5076-4ff6-92a9-8125f984b4a5" returned: 0 in 0.470s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:11 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-323f01e5-342c-4b1f-a65b-f54f6fcc4477 tempest-VolumesExtendTest-215802513 None] Lock "cinder-quobyte-19dc8bd6-5076-4ff6-92a9-8125f984b4a5" released by "delete_volume" :: held 1.079s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:11 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-323f01e5-342c-4b1f-a65b-f54f6fcc4477 tempest-VolumesExtendTest-215802513 None] Created reservations ['be75c5de-ddf9-4c70-a169-034a8e89f592', '301182dc-605d-411a-9e5d-5d0ca22afa54', 'd5e3cf32-0223-4775-881b-39a8abc7148d', '31707e21-9c5f-4e2a-a64d-9ce9b06f211b'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:46:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-323f01e5-342c-4b1f-a65b-f54f6fcc4477 tempest-VolumesExtendTest-215802513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-323f01e5-342c-4b1f-a65b-f54f6fcc4477 tempest-VolumesExtendTest-215802513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:11 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-323f01e5-342c-4b1f-a65b-f54f6fcc4477 tempest-VolumesExtendTest-215802513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:46:11 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-323f01e5-342c-4b1f-a65b-f54f6fcc4477 tempest-VolumesExtendTest-215802513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:46:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-323f01e5-342c-4b1f-a65b-f54f6fcc4477 tempest-VolumesExtendTest-215802513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-323f01e5-342c-4b1f-a65b-f54f6fcc4477 tempest-VolumesExtendTest-215802513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:11 devstack sudo[89258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:46:11 devstack sudo[89258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:11 devstack sudo[89255]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-24d63a8d-682b-4562-9d0a-f6c7085fb06e" returned: 1 in 0.564s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-24d63a8d-682b-4562-9d0a-f6c7085fb06e' failed. Not Retrying. {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 28 04:46:11 devstack cinder-volume[84248]: DEBUG cinder.volume.volume_utils [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Downloaded image 2c3eb214-ef72-4569-9890-199b020755f9 ((None, [{'url': 'file:///opt/stack/data/glance/images/2c3eb214-ef72-4569-9890-199b020755f9', 'metadata': {}}])) to volume 24d63a8d-682b-4562-9d0a-f6c7085fb06e successfully. {{(pid=84248) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Feb 28 04:46:11 devstack cinder-volume[84248]: DEBUG cinder.image.image_utils [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Temporary image 2c3eb214-ef72-4569-9890-199b020755f9 for user 2247d4e35589438db75df793320c521a is deleted. {{(pid=84248) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Feb 28 04:46:11 devstack cinder-volume[84248]: DEBUG cinder.volume.volume_utils [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Marking volume 24d63a8d-682b-4562-9d0a-f6c7085fb06e as bootable. {{(pid=84248) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Feb 28 04:46:11 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Copying metadata from image 2c3eb214-ef72-4569-9890-199b020755f9 to 24d63a8d-682b-4562-9d0a-f6c7085fb06e. {{(pid=84248) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Feb 28 04:46:11 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Creating volume glance metadata for volume 24d63a8d-682b-4562-9d0a-f6c7085fb06e backed by image 2c3eb214-ef72-4569-9890-199b020755f9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2c3eb214-ef72-4569-9890-199b020755f9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84248) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Feb 28 04:46:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e27760c-378e-4247-87ad-b97a5b331b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24d63a8d-682b-4562-9d0a-f6c7085fb06e', 'volume_size': 1, 'image_id': '2c3eb214-ef72-4569-9890-199b020755f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2c3eb214-ef72-4569-9890-199b020755f9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c0fde1a75874ab3961d0c965899b1f4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2c3eb214-ef72-4569-9890-199b020755f9', 'created_at': datetime.datetime(2026, 2, 28, 3, 36, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 28, 3, 36, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2c3eb214-ef72-4569-9890-199b020755f9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5e35e526b0>}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08e79f43-4384-4cb4-9db3-39a622b9fd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:11 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Volume volume-24d63a8d-682b-4562-9d0a-f6c7085fb06e (24d63a8d-682b-4562-9d0a-f6c7085fb06e): created successfully
Feb 28 04:46:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08e79f43-4384-4cb4-9db3-39a622b9fd27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Flow 'volume_create_manager' (dc58ef26-8fe8-4523-b231-4a2a66d6f475) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:46:11 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-a8c92bed-9d5a-4683-9fe4-73920d385734 tempest-VolumesGetTest-507974651 None] Created volume successfully.
Feb 28 04:46:11 devstack sudo[89258]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-323f01e5-342c-4b1f-a65b-f54f6fcc4477 tempest-VolumesExtendTest-215802513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.450s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:11 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-323f01e5-342c-4b1f-a65b-f54f6fcc4477 tempest-VolumesExtendTest-215802513 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:46:11 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-323f01e5-342c-4b1f-a65b-f54f6fcc4477 tempest-VolumesExtendTest-215802513 None] Deleted volume successfully.
Feb 28 04:46:12 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-323f01e5-342c-4b1f-a65b-f54f6fcc4477 tempest-VolumesExtendTest-215802513 None] Lock "cinder-19dc8bd6-5076-4ff6-92a9-8125f984b4a5-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:12 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa69c0b1-4c7b-4cbf-b777-1fff2ecba54a tempest-VolumesTransfersV355Test-358046033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:46:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-fa69c0b1-4c7b-4cbf-b777-1fff2ecba54a tempest-VolumesTransfersV355Test-358046033 None] Flow 'volume_create_manager' (364c8bd6-9d7c-49ad-986c-082b2a72d956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:46:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-fa69c0b1-4c7b-4cbf-b777-1fff2ecba54a tempest-VolumesTransfersV355Test-358046033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28f3b028-a7fa-47bb-b57e-122fe6b1b569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-fa69c0b1-4c7b-4cbf-b777-1fff2ecba54a tempest-VolumesTransfersV355Test-358046033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28f3b028-a7fa-47bb-b57e-122fe6b1b569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:46:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1128683879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59604c89-f14d-48a3-a957-6d8bfea8864c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ca1a5f63c464c748f458afd4ccfd55f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:46:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:46:12Z,use_quota=True,user_id='dbdbe032a33c4687bc65ce4be0ee0e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-fa69c0b1-4c7b-4cbf-b777-1fff2ecba54a tempest-VolumesTransfersV355Test-358046033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (642e1911-d925-4ccf-9aa7-4b285c859a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-fa69c0b1-4c7b-4cbf-b777-1fff2ecba54a tempest-VolumesTransfersV355Test-358046033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (642e1911-d925-4ccf-9aa7-4b285c859a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-fa69c0b1-4c7b-4cbf-b777-1fff2ecba54a tempest-VolumesTransfersV355Test-358046033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a72fedb8-4aa9-4e26-a701-28ed922ae17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-fa69c0b1-4c7b-4cbf-b777-1fff2ecba54a tempest-VolumesTransfersV355Test-358046033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a72fedb8-4aa9-4e26-a701-28ed922ae17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59604c89-f14d-48a3-a957-6d8bfea8864c', 'volume_name': 'volume-59604c89-f14d-48a3-a957-6d8bfea8864c', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-fa69c0b1-4c7b-4cbf-b777-1fff2ecba54a tempest-VolumesTransfersV355Test-358046033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58384afe-0fda-4b75-bbd0-bfb0d045de8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-fa69c0b1-4c7b-4cbf-b777-1fff2ecba54a tempest-VolumesTransfersV355Test-358046033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58384afe-0fda-4b75-bbd0-bfb0d045de8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-fa69c0b1-4c7b-4cbf-b777-1fff2ecba54a tempest-VolumesTransfersV355Test-358046033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5237b57-2b4f-4efc-97ea-f2349cbeb33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:12 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-fa69c0b1-4c7b-4cbf-b777-1fff2ecba54a tempest-VolumesTransfersV355Test-358046033 None] Volume 59604c89-f14d-48a3-a957-6d8bfea8864c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59604c89-f14d-48a3-a957-6d8bfea8864c', 'volume_size': 1}
Feb 28 04:46:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-fa69c0b1-4c7b-4cbf-b777-1fff2ecba54a tempest-VolumesTransfersV355Test-358046033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-fa69c0b1-4c7b-4cbf-b777-1fff2ecba54a tempest-VolumesTransfersV355Test-358046033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:12 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-fa69c0b1-4c7b-4cbf-b777-1fff2ecba54a tempest-VolumesTransfersV355Test-358046033 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:46:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1128683879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59604c89-f14d-48a3-a957-6d8bfea8864c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ca1a5f63c464c748f458afd4ccfd55f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:46:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:46:12Z,use_quota=True,user_id='dbdbe032a33c4687bc65ce4be0ee0e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:46:12 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-fa69c0b1-4c7b-4cbf-b777-1fff2ecba54a tempest-VolumesTransfersV355Test-358046033 None] Creating volume 59604c89-f14d-48a3-a957-6d8bfea8864c {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:46:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-fa69c0b1-4c7b-4cbf-b777-1fff2ecba54a tempest-VolumesTransfersV355Test-358046033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-fa69c0b1-4c7b-4cbf-b777-1fff2ecba54a tempest-VolumesTransfersV355Test-358046033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:12 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-fa69c0b1-4c7b-4cbf-b777-1fff2ecba54a tempest-VolumesTransfersV355Test-358046033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:46:12 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-fa69c0b1-4c7b-4cbf-b777-1fff2ecba54a tempest-VolumesTransfersV355Test-358046033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:46:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-fa69c0b1-4c7b-4cbf-b777-1fff2ecba54a tempest-VolumesTransfersV355Test-358046033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:12 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-fa69c0b1-4c7b-4cbf-b777-1fff2ecba54a tempest-VolumesTransfersV355Test-358046033 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:46:12 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-fa69c0b1-4c7b-4cbf-b777-1fff2ecba54a tempest-VolumesTransfersV355Test-358046033 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:46:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-fa69c0b1-4c7b-4cbf-b777-1fff2ecba54a tempest-VolumesTransfersV355Test-358046033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59604c89-f14d-48a3-a957-6d8bfea8864c 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:12 devstack sudo[89264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59604c89-f14d-48a3-a957-6d8bfea8864c 1073741824
Feb 28 04:46:12 devstack sudo[89264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:12 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-11c4a892-d861-4c9b-9488-95f9e5748451 tempest-GroupsTest-587314363 None] Acquiring lock "cinder-quobyte-1830435b-a024-4e95-8281-0c61f23d9116" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:12 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-11c4a892-d861-4c9b-9488-95f9e5748451 tempest-GroupsTest-587314363 None] Lock "cinder-quobyte-1830435b-a024-4e95-8281-0c61f23d9116" acquired by "delete_volume" :: waited 0.008s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:12 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac249147-30d7-45c1-a481-134ce92b880f]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-11c4a892-d861-4c9b-9488-95f9e5748451 tempest-GroupsTest-587314363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1830435b-a024-4e95-8281-0c61f23d9116 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:12 devstack sudo[89266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1830435b-a024-4e95-8281-0c61f23d9116
Feb 28 04:46:12 devstack sudo[89266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:12 devstack sudo[89264]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-fa69c0b1-4c7b-4cbf-b777-1fff2ecba54a tempest-VolumesTransfersV355Test-358046033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59604c89-f14d-48a3-a957-6d8bfea8864c 1073741824" returned: 0 in 0.570s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-fa69c0b1-4c7b-4cbf-b777-1fff2ecba54a tempest-VolumesTransfersV355Test-358046033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59604c89-f14d-48a3-a957-6d8bfea8864c {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:12 devstack sudo[89266]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-11c4a892-d861-4c9b-9488-95f9e5748451 tempest-GroupsTest-587314363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1830435b-a024-4e95-8281-0c61f23d9116" returned: 0 in 0.545s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-11c4a892-d861-4c9b-9488-95f9e5748451 tempest-GroupsTest-587314363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1830435b-a024-4e95-8281-0c61f23d9116 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:12 devstack sudo[89274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59604c89-f14d-48a3-a957-6d8bfea8864c
Feb 28 04:46:12 devstack sudo[89274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:12 devstack sudo[89275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1830435b-a024-4e95-8281-0c61f23d9116
Feb 28 04:46:12 devstack sudo[89275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:12 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a24b212-77a4-451f-ac37-e604b69bb23a tempest-VolumesGetTest-507974651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:46:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3a24b212-77a4-451f-ac37-e604b69bb23a tempest-VolumesGetTest-507974651 None] Flow 'volume_create_manager' (7f0cdb08-f113-4d64-91fb-b39d5dbbe637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:46:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3a24b212-77a4-451f-ac37-e604b69bb23a tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bbcb2eb-b9ce-4462-870e-481082476893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3a24b212-77a4-451f-ac37-e604b69bb23a tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bbcb2eb-b9ce-4462-870e-481082476893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:46:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1528784113',display_name='tempest-VolumesGetTest-Volume-1875251864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adcd0294-79ab-4895-b980-6d7b161cb884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='992ba50d9e4a432fbe7b2db9bbd34498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:46:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:46:13Z,use_quota=True,user_id='2247d4e35589438db75df793320c521a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3a24b212-77a4-451f-ac37-e604b69bb23a tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f596562-b8dd-4d9a-93f3-d5bc1eb24076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3a24b212-77a4-451f-ac37-e604b69bb23a tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f596562-b8dd-4d9a-93f3-d5bc1eb24076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3a24b212-77a4-451f-ac37-e604b69bb23a tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e3f72f8-32a7-4b8d-8d9a-5a6678de4e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3a24b212-77a4-451f-ac37-e604b69bb23a tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e3f72f8-32a7-4b8d-8d9a-5a6678de4e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adcd0294-79ab-4895-b980-6d7b161cb884', 'volume_name': 'volume-adcd0294-79ab-4895-b980-6d7b161cb884', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3a24b212-77a4-451f-ac37-e604b69bb23a tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef43cd4d-cea0-4548-be68-e3832b741c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3a24b212-77a4-451f-ac37-e604b69bb23a tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef43cd4d-cea0-4548-be68-e3832b741c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3a24b212-77a4-451f-ac37-e604b69bb23a tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccd27e89-2366-407f-b898-cf4de8b6e88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:12 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-3a24b212-77a4-451f-ac37-e604b69bb23a tempest-VolumesGetTest-507974651 None] Volume adcd0294-79ab-4895-b980-6d7b161cb884: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adcd0294-79ab-4895-b980-6d7b161cb884', 'volume_size': 1}
Feb 28 04:46:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3a24b212-77a4-451f-ac37-e604b69bb23a tempest-VolumesGetTest-507974651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:13 devstack sudo[89274]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-fa69c0b1-4c7b-4cbf-b777-1fff2ecba54a tempest-VolumesTransfersV355Test-358046033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59604c89-f14d-48a3-a957-6d8bfea8864c" returned: 0 in 0.486s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:13 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-fa69c0b1-4c7b-4cbf-b777-1fff2ecba54a tempest-VolumesTransfersV355Test-358046033 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:46:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-fa69c0b1-4c7b-4cbf-b777-1fff2ecba54a tempest-VolumesTransfersV355Test-358046033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3a24b212-77a4-451f-ac37-e604b69bb23a tempest-VolumesGetTest-507974651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.317s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:13 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-3a24b212-77a4-451f-ac37-e604b69bb23a tempest-VolumesGetTest-507974651 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:46:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1528784113',display_name='tempest-VolumesGetTest-Volume-1875251864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adcd0294-79ab-4895-b980-6d7b161cb884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='992ba50d9e4a432fbe7b2db9bbd34498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:46:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:46:13Z,use_quota=True,user_id='2247d4e35589438db75df793320c521a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:46:13 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-3a24b212-77a4-451f-ac37-e604b69bb23a tempest-VolumesGetTest-507974651 None] Creating volume adcd0294-79ab-4895-b980-6d7b161cb884 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:46:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3a24b212-77a4-451f-ac37-e604b69bb23a tempest-VolumesGetTest-507974651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3a24b212-77a4-451f-ac37-e604b69bb23a tempest-VolumesGetTest-507974651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:13 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-3a24b212-77a4-451f-ac37-e604b69bb23a tempest-VolumesGetTest-507974651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:46:13 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-3a24b212-77a4-451f-ac37-e604b69bb23a tempest-VolumesGetTest-507974651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:46:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3a24b212-77a4-451f-ac37-e604b69bb23a tempest-VolumesGetTest-507974651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:13 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-3a24b212-77a4-451f-ac37-e604b69bb23a tempest-VolumesGetTest-507974651 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:46:13 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-3a24b212-77a4-451f-ac37-e604b69bb23a tempest-VolumesGetTest-507974651 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:46:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3a24b212-77a4-451f-ac37-e604b69bb23a tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-adcd0294-79ab-4895-b980-6d7b161cb884 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:13 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-fa69c0b1-4c7b-4cbf-b777-1fff2ecba54a tempest-VolumesTransfersV355Test-358046033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5237b57-2b4f-4efc-97ea-f2349cbeb33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59604c89-f14d-48a3-a957-6d8bfea8864c', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:13 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-fa69c0b1-4c7b-4cbf-b777-1fff2ecba54a tempest-VolumesTransfersV355Test-358046033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5442c29-3751-43df-8208-da32089952f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:13 devstack sudo[89280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-adcd0294-79ab-4895-b980-6d7b161cb884 1073741824
Feb 28 04:46:13 devstack sudo[89280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:13 devstack sudo[89275]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:13 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-fa69c0b1-4c7b-4cbf-b777-1fff2ecba54a tempest-VolumesTransfersV355Test-358046033 None] Volume volume-59604c89-f14d-48a3-a957-6d8bfea8864c (59604c89-f14d-48a3-a957-6d8bfea8864c): created successfully
Feb 28 04:46:13 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-fa69c0b1-4c7b-4cbf-b777-1fff2ecba54a tempest-VolumesTransfersV355Test-358046033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5442c29-3751-43df-8208-da32089952f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:13 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-fa69c0b1-4c7b-4cbf-b777-1fff2ecba54a tempest-VolumesTransfersV355Test-358046033 None] Flow 'volume_create_manager' (364c8bd6-9d7c-49ad-986c-082b2a72d956) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:46:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-11c4a892-d861-4c9b-9488-95f9e5748451 tempest-GroupsTest-587314363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1830435b-a024-4e95-8281-0c61f23d9116" returned: 0 in 0.495s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:13 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-fa69c0b1-4c7b-4cbf-b777-1fff2ecba54a tempest-VolumesTransfersV355Test-358046033 None] Created volume successfully.
Feb 28 04:46:13 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-11c4a892-d861-4c9b-9488-95f9e5748451 tempest-GroupsTest-587314363 None] Lock "cinder-quobyte-1830435b-a024-4e95-8281-0c61f23d9116" released by "delete_volume" :: held 1.076s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:13 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-11c4a892-d861-4c9b-9488-95f9e5748451 tempest-GroupsTest-587314363 None] Acquiring lock "cinder-quobyte-b60b7440-229d-491c-94ec-c1e41f27b589" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:13 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-11c4a892-d861-4c9b-9488-95f9e5748451 tempest-GroupsTest-587314363 None] Lock "cinder-quobyte-b60b7440-229d-491c-94ec-c1e41f27b589" acquired by "delete_volume" :: waited 0.013s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:13 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebd98c5-0354-4346-950c-d18bdf5fd005]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-11c4a892-d861-4c9b-9488-95f9e5748451 tempest-GroupsTest-587314363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b60b7440-229d-491c-94ec-c1e41f27b589 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:13 devstack sudo[89282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b60b7440-229d-491c-94ec-c1e41f27b589
Feb 28 04:46:13 devstack sudo[89282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:13 devstack sudo[89280]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3a24b212-77a4-451f-ac37-e604b69bb23a tempest-VolumesGetTest-507974651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-adcd0294-79ab-4895-b980-6d7b161cb884 1073741824" returned: 0 in 0.578s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3a24b212-77a4-451f-ac37-e604b69bb23a tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-adcd0294-79ab-4895-b980-6d7b161cb884 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:13 devstack sudo[89290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-adcd0294-79ab-4895-b980-6d7b161cb884
Feb 28 04:46:13 devstack sudo[89282]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:13 devstack sudo[89290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-11c4a892-d861-4c9b-9488-95f9e5748451 tempest-GroupsTest-587314363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b60b7440-229d-491c-94ec-c1e41f27b589" returned: 0 in 0.518s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-11c4a892-d861-4c9b-9488-95f9e5748451 tempest-GroupsTest-587314363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b60b7440-229d-491c-94ec-c1e41f27b589 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:13 devstack sudo[89292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b60b7440-229d-491c-94ec-c1e41f27b589
Feb 28 04:46:13 devstack sudo[89292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:14 devstack sudo[89290]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3a24b212-77a4-451f-ac37-e604b69bb23a tempest-VolumesGetTest-507974651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-adcd0294-79ab-4895-b980-6d7b161cb884" returned: 0 in 0.429s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:14 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-3a24b212-77a4-451f-ac37-e604b69bb23a tempest-VolumesGetTest-507974651 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:46:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3a24b212-77a4-451f-ac37-e604b69bb23a tempest-VolumesGetTest-507974651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:14 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3a24b212-77a4-451f-ac37-e604b69bb23a tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccd27e89-2366-407f-b898-cf4de8b6e88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adcd0294-79ab-4895-b980-6d7b161cb884', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:14 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3a24b212-77a4-451f-ac37-e604b69bb23a tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bcb1abe-fe98-44e0-b5e9-dbc965ce1a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:14 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-3a24b212-77a4-451f-ac37-e604b69bb23a tempest-VolumesGetTest-507974651 None] Volume volume-adcd0294-79ab-4895-b980-6d7b161cb884 (adcd0294-79ab-4895-b980-6d7b161cb884): created successfully
Feb 28 04:46:14 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3a24b212-77a4-451f-ac37-e604b69bb23a tempest-VolumesGetTest-507974651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bcb1abe-fe98-44e0-b5e9-dbc965ce1a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:14 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3a24b212-77a4-451f-ac37-e604b69bb23a tempest-VolumesGetTest-507974651 None] Flow 'volume_create_manager' (7f0cdb08-f113-4d64-91fb-b39d5dbbe637) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:46:14 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-3a24b212-77a4-451f-ac37-e604b69bb23a tempest-VolumesGetTest-507974651 None] Created volume successfully.
Feb 28 04:46:14 devstack sudo[89292]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-11c4a892-d861-4c9b-9488-95f9e5748451 tempest-GroupsTest-587314363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b60b7440-229d-491c-94ec-c1e41f27b589" returned: 0 in 0.512s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:14 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-11c4a892-d861-4c9b-9488-95f9e5748451 tempest-GroupsTest-587314363 None] Lock "cinder-quobyte-b60b7440-229d-491c-94ec-c1e41f27b589" released by "delete_volume" :: held 1.071s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:14 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-11c4a892-d861-4c9b-9488-95f9e5748451 tempest-GroupsTest-587314363 None] Created reservations ['abf8c7ea-86d3-45a3-bb28-15fef0ae58c9'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:46:14 devstack cinder-volume[84248]: WARNING cinder.quota [None req-11c4a892-d861-4c9b-9488-95f9e5748451 tempest-GroupsTest-587314363 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2023686949 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2023686949, it is now deprecated. Please use the default quota class for default quota.
Feb 28 04:46:14 devstack cinder-volume[84248]: WARNING cinder.quota [None req-11c4a892-d861-4c9b-9488-95f9e5748451 tempest-GroupsTest-587314363 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2023686949 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2023686949, it is now deprecated. Please use the default quota class for default quota.
Feb 28 04:46:14 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-11c4a892-d861-4c9b-9488-95f9e5748451 tempest-GroupsTest-587314363 None] Created reservations ['d13e8b2f-5d66-4608-9b0e-04303a4244d5', 'ea1e8da2-b32e-46bd-b890-473120b77289', 'f0896457-0c57-4334-80d5-335a3ad68f5f', '7b5f1a0d-d481-4242-b062-0818ff40cd07'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:46:14 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-11c4a892-d861-4c9b-9488-95f9e5748451 tempest-GroupsTest-587314363 None] Created reservations ['4693ae6f-eef4-42a3-b4aa-1d25f80ad6fe', '5c351bde-a614-46a1-8a06-dd7be94f7a9f', '3a231434-c6ba-4f73-911a-e25cee4d0e00', 'fb728c82-67f5-4c32-abf6-7fae88d6b916'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:46:14 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0851ddd-7744-40c7-970b-13ac0cf0698f tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:46:14 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a0851ddd-7744-40c7-970b-13ac0cf0698f tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Flow 'volume_create_manager' (8e485df3-ca59-4782-a4e5-c537ec4329ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:46:14 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a0851ddd-7744-40c7-970b-13ac0cf0698f tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (363212d0-df60-4520-981d-71be2b0b9b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:14 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a0851ddd-7744-40c7-970b-13ac0cf0698f tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (363212d0-df60-4520-981d-71be2b0b9b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-228067790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61914eed-a3fa-463f-8840-b845ac1b618d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b8d5cde3a649eda4378e75def12085',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:46:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:46:15Z,use_quota=True,user_id='5267ad674eb14f048273d81d0b9fbd24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:14 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a0851ddd-7744-40c7-970b-13ac0cf0698f tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (858ec1ed-bc4c-4987-a28e-96e4389b827f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:14 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a0851ddd-7744-40c7-970b-13ac0cf0698f tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (858ec1ed-bc4c-4987-a28e-96e4389b827f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:14 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a0851ddd-7744-40c7-970b-13ac0cf0698f tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eace381a-06ed-4257-bf96-a64b92182da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:14 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a0851ddd-7744-40c7-970b-13ac0cf0698f tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eace381a-06ed-4257-bf96-a64b92182da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61914eed-a3fa-463f-8840-b845ac1b618d', 'volume_name': 'volume-61914eed-a3fa-463f-8840-b845ac1b618d', 'volume_size': 2}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:14 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a0851ddd-7744-40c7-970b-13ac0cf0698f tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46ce2d9d-d71f-44e1-ac4c-981f218608e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:14 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a0851ddd-7744-40c7-970b-13ac0cf0698f tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46ce2d9d-d71f-44e1-ac4c-981f218608e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:14 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a0851ddd-7744-40c7-970b-13ac0cf0698f tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8805935-742b-4c10-8482-46544ee58324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:14 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-a0851ddd-7744-40c7-970b-13ac0cf0698f tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Volume 61914eed-a3fa-463f-8840-b845ac1b618d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61914eed-a3fa-463f-8840-b845ac1b618d', 'volume_size': 2}
Feb 28 04:46:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a0851ddd-7744-40c7-970b-13ac0cf0698f tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a0851ddd-7744-40c7-970b-13ac0cf0698f tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:14 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-a0851ddd-7744-40c7-970b-13ac0cf0698f tempest-VolumesSnapshotNegativeTestJSON-581799033 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-228067790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61914eed-a3fa-463f-8840-b845ac1b618d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b8d5cde3a649eda4378e75def12085',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:46:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:46:15Z,use_quota=True,user_id='5267ad674eb14f048273d81d0b9fbd24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:46:14 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-a0851ddd-7744-40c7-970b-13ac0cf0698f tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Creating volume 61914eed-a3fa-463f-8840-b845ac1b618d {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:46:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a0851ddd-7744-40c7-970b-13ac0cf0698f tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a0851ddd-7744-40c7-970b-13ac0cf0698f tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:14 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-a0851ddd-7744-40c7-970b-13ac0cf0698f tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:46:14 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-a0851ddd-7744-40c7-970b-13ac0cf0698f tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:46:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a0851ddd-7744-40c7-970b-13ac0cf0698f tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:14 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-a0851ddd-7744-40c7-970b-13ac0cf0698f tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:46:14 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-a0851ddd-7744-40c7-970b-13ac0cf0698f tempest-VolumesSnapshotNegativeTestJSON-581799033 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:46:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a0851ddd-7744-40c7-970b-13ac0cf0698f tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d 2147483648 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:14 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-a8966047-11cc-4246-83e9-d52efc372e50 tempest-VolumesTransfersV355Test-573347565 None] Transfer volume completed successfully.
Feb 28 04:46:14 devstack sudo[89296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d 2147483648
Feb 28 04:46:14 devstack sudo[89296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-11c4a892-d861-4c9b-9488-95f9e5748451 tempest-GroupsTest-587314363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-11c4a892-d861-4c9b-9488-95f9e5748451 tempest-GroupsTest-587314363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:14 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-11c4a892-d861-4c9b-9488-95f9e5748451 tempest-GroupsTest-587314363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:46:14 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-11c4a892-d861-4c9b-9488-95f9e5748451 tempest-GroupsTest-587314363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:46:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-11c4a892-d861-4c9b-9488-95f9e5748451 tempest-GroupsTest-587314363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-11c4a892-d861-4c9b-9488-95f9e5748451 tempest-GroupsTest-587314363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:14 devstack sudo[89298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:46:14 devstack sudo[89298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:15 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-fe4ab698-f8f4-47f2-9eb2-b226747a86e0 tempest-VolumesGetTest-507974651 None] Acquiring lock "cinder-adcd0294-79ab-4895-b980-6d7b161cb884-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:15 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-fe4ab698-f8f4-47f2-9eb2-b226747a86e0 tempest-VolumesGetTest-507974651 None] Lock "cinder-adcd0294-79ab-4895-b980-6d7b161cb884-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:15 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-fe4ab698-f8f4-47f2-9eb2-b226747a86e0 tempest-VolumesGetTest-507974651 None] Acquiring lock "cinder-quobyte-adcd0294-79ab-4895-b980-6d7b161cb884" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:15 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-fe4ab698-f8f4-47f2-9eb2-b226747a86e0 tempest-VolumesGetTest-507974651 None] Lock "cinder-quobyte-adcd0294-79ab-4895-b980-6d7b161cb884" acquired by "delete_volume" :: waited 0.010s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:15 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[79874cca-862d-4685-93bf-df636de3a990]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-fe4ab698-f8f4-47f2-9eb2-b226747a86e0 tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-adcd0294-79ab-4895-b980-6d7b161cb884 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:15 devstack sudo[89298]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-11c4a892-d861-4c9b-9488-95f9e5748451 tempest-GroupsTest-587314363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.459s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:15 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-11c4a892-d861-4c9b-9488-95f9e5748451 tempest-GroupsTest-587314363 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:46:15 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-11c4a892-d861-4c9b-9488-95f9e5748451 tempest-GroupsTest-587314363 None] Delete group completed successfully.
Feb 28 04:46:15 devstack sudo[89296]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a0851ddd-7744-40c7-970b-13ac0cf0698f tempest-VolumesSnapshotNegativeTestJSON-581799033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d 2147483648" returned: 0 in 0.548s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a0851ddd-7744-40c7-970b-13ac0cf0698f tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:15 devstack sudo[89304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-adcd0294-79ab-4895-b980-6d7b161cb884
Feb 28 04:46:15 devstack sudo[89304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:15 devstack sudo[89306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d
Feb 28 04:46:15 devstack sudo[89306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:15 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-2a17d241-a4e6-4006-8ab1-da6f30027857 tempest-VolumesTransfersV355Test-132225934 None] Acquiring lock "cinder-59604c89-f14d-48a3-a957-6d8bfea8864c-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:15 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-2a17d241-a4e6-4006-8ab1-da6f30027857 tempest-VolumesTransfersV355Test-132225934 None] Lock "cinder-59604c89-f14d-48a3-a957-6d8bfea8864c-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:15 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-2a17d241-a4e6-4006-8ab1-da6f30027857 tempest-VolumesTransfersV355Test-132225934 None] Acquiring lock "cinder-quobyte-59604c89-f14d-48a3-a957-6d8bfea8864c" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:15 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-2a17d241-a4e6-4006-8ab1-da6f30027857 tempest-VolumesTransfersV355Test-132225934 None] Lock "cinder-quobyte-59604c89-f14d-48a3-a957-6d8bfea8864c" acquired by "delete_volume" :: waited 0.008s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:15 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f846255-7d66-4b2a-9e8e-e18308942eeb]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-2a17d241-a4e6-4006-8ab1-da6f30027857 tempest-VolumesTransfersV355Test-132225934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59604c89-f14d-48a3-a957-6d8bfea8864c {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:15 devstack sudo[89308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59604c89-f14d-48a3-a957-6d8bfea8864c
Feb 28 04:46:15 devstack sudo[89308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:15 devstack sudo[89304]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-fe4ab698-f8f4-47f2-9eb2-b226747a86e0 tempest-VolumesGetTest-507974651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-adcd0294-79ab-4895-b980-6d7b161cb884" returned: 0 in 0.600s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-fe4ab698-f8f4-47f2-9eb2-b226747a86e0 tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-adcd0294-79ab-4895-b980-6d7b161cb884 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:15 devstack sudo[89314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-adcd0294-79ab-4895-b980-6d7b161cb884
Feb 28 04:46:15 devstack sudo[89314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:15 devstack sudo[89306]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a0851ddd-7744-40c7-970b-13ac0cf0698f tempest-VolumesSnapshotNegativeTestJSON-581799033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d" returned: 0 in 0.525s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:15 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-a0851ddd-7744-40c7-970b-13ac0cf0698f tempest-VolumesSnapshotNegativeTestJSON-581799033 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:46:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a0851ddd-7744-40c7-970b-13ac0cf0698f tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:15 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a0851ddd-7744-40c7-970b-13ac0cf0698f tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8805935-742b-4c10-8482-46544ee58324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61914eed-a3fa-463f-8840-b845ac1b618d', 'volume_size': 2}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:15 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a0851ddd-7744-40c7-970b-13ac0cf0698f tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b099620a-3ec1-46e0-951b-f24ed4514913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:15 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-a0851ddd-7744-40c7-970b-13ac0cf0698f tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Volume volume-61914eed-a3fa-463f-8840-b845ac1b618d (61914eed-a3fa-463f-8840-b845ac1b618d): created successfully
Feb 28 04:46:15 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a0851ddd-7744-40c7-970b-13ac0cf0698f tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b099620a-3ec1-46e0-951b-f24ed4514913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:15 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a0851ddd-7744-40c7-970b-13ac0cf0698f tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Flow 'volume_create_manager' (8e485df3-ca59-4782-a4e5-c537ec4329ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:46:15 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-a0851ddd-7744-40c7-970b-13ac0cf0698f tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Created volume successfully.
Feb 28 04:46:16 devstack sudo[89308]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-2a17d241-a4e6-4006-8ab1-da6f30027857 tempest-VolumesTransfersV355Test-132225934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59604c89-f14d-48a3-a957-6d8bfea8864c" returned: 0 in 0.531s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-2a17d241-a4e6-4006-8ab1-da6f30027857 tempest-VolumesTransfersV355Test-132225934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59604c89-f14d-48a3-a957-6d8bfea8864c {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:16 devstack sudo[89319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59604c89-f14d-48a3-a957-6d8bfea8864c
Feb 28 04:46:16 devstack sudo[89319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:16 devstack sudo[89314]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-fe4ab698-f8f4-47f2-9eb2-b226747a86e0 tempest-VolumesGetTest-507974651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-adcd0294-79ab-4895-b980-6d7b161cb884" returned: 0 in 0.444s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:16 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-fe4ab698-f8f4-47f2-9eb2-b226747a86e0 tempest-VolumesGetTest-507974651 None] Lock "cinder-quobyte-adcd0294-79ab-4895-b980-6d7b161cb884" released by "delete_volume" :: held 1.082s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:16 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-fe4ab698-f8f4-47f2-9eb2-b226747a86e0 tempest-VolumesGetTest-507974651 None] Created reservations ['a52ef083-95bd-4ffa-949b-49c53a198509', '1d63d1df-e594-49e9-8514-dd4ed488c32b', '4233b61d-b8fc-4c6d-adc8-a2c2dac0e43d', 'c1c17627-0906-4005-af38-5f445c4c2ac3'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:46:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-fe4ab698-f8f4-47f2-9eb2-b226747a86e0 tempest-VolumesGetTest-507974651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-fe4ab698-f8f4-47f2-9eb2-b226747a86e0 tempest-VolumesGetTest-507974651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:16 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-fe4ab698-f8f4-47f2-9eb2-b226747a86e0 tempest-VolumesGetTest-507974651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:46:16 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-fe4ab698-f8f4-47f2-9eb2-b226747a86e0 tempest-VolumesGetTest-507974651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:46:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-fe4ab698-f8f4-47f2-9eb2-b226747a86e0 tempest-VolumesGetTest-507974651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-fe4ab698-f8f4-47f2-9eb2-b226747a86e0 tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:16 devstack sudo[89322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:46:16 devstack sudo[89322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:16 devstack sudo[89319]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-2a17d241-a4e6-4006-8ab1-da6f30027857 tempest-VolumesTransfersV355Test-132225934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59604c89-f14d-48a3-a957-6d8bfea8864c" returned: 0 in 0.452s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:16 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-2a17d241-a4e6-4006-8ab1-da6f30027857 tempest-VolumesTransfersV355Test-132225934 None] Lock "cinder-quobyte-59604c89-f14d-48a3-a957-6d8bfea8864c" released by "delete_volume" :: held 1.011s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:16 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-2a17d241-a4e6-4006-8ab1-da6f30027857 tempest-VolumesTransfersV355Test-132225934 None] Created reservations ['54cb0708-4cf6-4130-9ec1-f7048359c905', '098f2041-504f-4115-abe0-9f4163c4be40', 'b1b483c1-4e92-4eff-8bd5-9fb734f5002a', 'e4ef013e-3867-403b-a601-7d02969d2be2'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:46:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-2a17d241-a4e6-4006-8ab1-da6f30027857 tempest-VolumesTransfersV355Test-132225934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-2a17d241-a4e6-4006-8ab1-da6f30027857 tempest-VolumesTransfersV355Test-132225934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:16 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-2a17d241-a4e6-4006-8ab1-da6f30027857 tempest-VolumesTransfersV355Test-132225934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:46:16 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-2a17d241-a4e6-4006-8ab1-da6f30027857 tempest-VolumesTransfersV355Test-132225934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:46:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-2a17d241-a4e6-4006-8ab1-da6f30027857 tempest-VolumesTransfersV355Test-132225934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-2a17d241-a4e6-4006-8ab1-da6f30027857 tempest-VolumesTransfersV355Test-132225934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:16 devstack sudo[89325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:46:16 devstack sudo[89325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:16 devstack sudo[89322]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-fe4ab698-f8f4-47f2-9eb2-b226747a86e0 tempest-VolumesGetTest-507974651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.466s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:16 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-fe4ab698-f8f4-47f2-9eb2-b226747a86e0 tempest-VolumesGetTest-507974651 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:46:16 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-fe4ab698-f8f4-47f2-9eb2-b226747a86e0 tempest-VolumesGetTest-507974651 None] Deleted volume successfully.
Feb 28 04:46:16 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-fe4ab698-f8f4-47f2-9eb2-b226747a86e0 tempest-VolumesGetTest-507974651 None] Lock "cinder-adcd0294-79ab-4895-b980-6d7b161cb884-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-faa7d942-0d0c-49bc-966a-40ffead1bb26 tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-faa7d942-0d0c-49bc-966a-40ffead1bb26 tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:16 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-faa7d942-0d0c-49bc-966a-40ffead1bb26 tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Creating offline snapshot 5947f9d0-ebf1-4e80-a091-e0b4b8463dba of volume 61914eed-a3fa-463f-8840-b845ac1b618d {{(pid=84248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 04:46:16 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64911ca-8397-4411-9e9b-c45ea427d813]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-faa7d942-0d0c-49bc-966a-40ffead1bb26 tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:17 devstack sudo[89328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d
Feb 28 04:46:17 devstack sudo[89328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:17 devstack sudo[89325]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-2a17d241-a4e6-4006-8ab1-da6f30027857 tempest-VolumesTransfersV355Test-132225934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.513s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:17 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-2a17d241-a4e6-4006-8ab1-da6f30027857 tempest-VolumesTransfersV355Test-132225934 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:46:17 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-2a17d241-a4e6-4006-8ab1-da6f30027857 tempest-VolumesTransfersV355Test-132225934 None] Deleted volume successfully.
Feb 28 04:46:17 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-2a17d241-a4e6-4006-8ab1-da6f30027857 tempest-VolumesTransfersV355Test-132225934 None] Lock "cinder-59604c89-f14d-48a3-a957-6d8bfea8864c-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:17 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-447d8d98-25e9-43f4-a67e-425de8a9a27a tempest-VolumesGetTest-507974651 None] Acquiring lock "cinder-24d63a8d-682b-4562-9d0a-f6c7085fb06e-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:17 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-447d8d98-25e9-43f4-a67e-425de8a9a27a tempest-VolumesGetTest-507974651 None] Lock "cinder-24d63a8d-682b-4562-9d0a-f6c7085fb06e-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:17 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-447d8d98-25e9-43f4-a67e-425de8a9a27a tempest-VolumesGetTest-507974651 None] Acquiring lock "cinder-quobyte-24d63a8d-682b-4562-9d0a-f6c7085fb06e" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:17 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-447d8d98-25e9-43f4-a67e-425de8a9a27a tempest-VolumesGetTest-507974651 None] Lock "cinder-quobyte-24d63a8d-682b-4562-9d0a-f6c7085fb06e" acquired by "delete_volume" :: waited 0.007s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:17 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[0007e441-00ea-4f20-b882-3667d5863427]: (4, 'raw') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-447d8d98-25e9-43f4-a67e-425de8a9a27a tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-24d63a8d-682b-4562-9d0a-f6c7085fb06e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:17 devstack sudo[89328]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-faa7d942-0d0c-49bc-966a-40ffead1bb26 tempest-VolumesSnapshotNegativeTestJSON-581799033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d" returned: 0 in 0.615s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-faa7d942-0d0c-49bc-966a-40ffead1bb26 tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d.5947f9d0-ebf1-4e80-a091-e0b4b8463dba 2G {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:17 devstack sudo[89369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d.5947f9d0-ebf1-4e80-a091-e0b4b8463dba 2G
Feb 28 04:46:17 devstack sudo[89369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:17 devstack sudo[89368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-24d63a8d-682b-4562-9d0a-f6c7085fb06e
Feb 28 04:46:17 devstack sudo[89368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:18 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-280e57f7-9bd0-4b2e-801e-4790e283359d tempest-VolumesTransfersV355Test-358046033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:46:18 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-280e57f7-9bd0-4b2e-801e-4790e283359d tempest-VolumesTransfersV355Test-358046033 None] Flow 'volume_create_manager' (b3829ed6-59d3-4c31-b4c5-c46d57803e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:46:18 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-280e57f7-9bd0-4b2e-801e-4790e283359d tempest-VolumesTransfersV355Test-358046033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8a19826-9ea9-4269-84e2-d5168a53ea5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:18 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-280e57f7-9bd0-4b2e-801e-4790e283359d tempest-VolumesTransfersV355Test-358046033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8a19826-9ea9-4269-84e2-d5168a53ea5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:46:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2017590988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45d0a4fa-fc79-4bb6-be82-ae9a2e424e50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ca1a5f63c464c748f458afd4ccfd55f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:46:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:46:18Z,use_quota=True,user_id='dbdbe032a33c4687bc65ce4be0ee0e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:18 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-280e57f7-9bd0-4b2e-801e-4790e283359d tempest-VolumesTransfersV355Test-358046033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd0529b7-cdad-4fdd-97ad-ef1e5fd7f706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:18 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-280e57f7-9bd0-4b2e-801e-4790e283359d tempest-VolumesTransfersV355Test-358046033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd0529b7-cdad-4fdd-97ad-ef1e5fd7f706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:18 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-280e57f7-9bd0-4b2e-801e-4790e283359d tempest-VolumesTransfersV355Test-358046033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2021c3fe-b8e3-4c87-a464-3312d32f837a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:18 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-280e57f7-9bd0-4b2e-801e-4790e283359d tempest-VolumesTransfersV355Test-358046033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2021c3fe-b8e3-4c87-a464-3312d32f837a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45d0a4fa-fc79-4bb6-be82-ae9a2e424e50', 'volume_name': 'volume-45d0a4fa-fc79-4bb6-be82-ae9a2e424e50', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:18 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-280e57f7-9bd0-4b2e-801e-4790e283359d tempest-VolumesTransfersV355Test-358046033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2b5bcc4-932f-4783-b408-ee4ab2250566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:18 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-280e57f7-9bd0-4b2e-801e-4790e283359d tempest-VolumesTransfersV355Test-358046033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2b5bcc4-932f-4783-b408-ee4ab2250566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:18 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-280e57f7-9bd0-4b2e-801e-4790e283359d tempest-VolumesTransfersV355Test-358046033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ff9bc55-a5fc-46c2-b39c-7bda3fce7320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:18 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-280e57f7-9bd0-4b2e-801e-4790e283359d tempest-VolumesTransfersV355Test-358046033 None] Volume 45d0a4fa-fc79-4bb6-be82-ae9a2e424e50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45d0a4fa-fc79-4bb6-be82-ae9a2e424e50', 'volume_size': 1}
Feb 28 04:46:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-280e57f7-9bd0-4b2e-801e-4790e283359d tempest-VolumesTransfersV355Test-358046033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:18 devstack sudo[89368]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-447d8d98-25e9-43f4-a67e-425de8a9a27a tempest-VolumesGetTest-507974651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-24d63a8d-682b-4562-9d0a-f6c7085fb06e" returned: 0 in 0.596s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-447d8d98-25e9-43f4-a67e-425de8a9a27a tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-24d63a8d-682b-4562-9d0a-f6c7085fb06e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:18 devstack sudo[89369]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-faa7d942-0d0c-49bc-966a-40ffead1bb26 tempest-VolumesSnapshotNegativeTestJSON-581799033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d.5947f9d0-ebf1-4e80-a091-e0b4b8463dba 2G" returned: 0 in 0.581s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-faa7d942-0d0c-49bc-966a-40ffead1bb26 tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61914eed-a3fa-463f-8840-b845ac1b618d -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d.5947f9d0-ebf1-4e80-a091-e0b4b8463dba {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:18 devstack sudo[89378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61914eed-a3fa-463f-8840-b845ac1b618d -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d.5947f9d0-ebf1-4e80-a091-e0b4b8463dba
Feb 28 04:46:18 devstack sudo[89378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:18 devstack sudo[89377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-24d63a8d-682b-4562-9d0a-f6c7085fb06e
Feb 28 04:46:18 devstack sudo[89377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:18 devstack sudo[89378]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-faa7d942-0d0c-49bc-966a-40ffead1bb26 tempest-VolumesSnapshotNegativeTestJSON-581799033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61914eed-a3fa-463f-8840-b845ac1b618d -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d.5947f9d0-ebf1-4e80-a091-e0b4b8463dba" returned: 0 in 0.490s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:18 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-faa7d942-0d0c-49bc-966a-40ffead1bb26 tempest-VolumesSnapshotNegativeTestJSON-581799033 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d.5947f9d0-ebf1-4e80-a091-e0b4b8463dba is being set with open permissions: ugo+rw
Feb 28 04:46:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-faa7d942-0d0c-49bc-966a-40ffead1bb26 tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d.5947f9d0-ebf1-4e80-a091-e0b4b8463dba {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:18 devstack sudo[89377]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-447d8d98-25e9-43f4-a67e-425de8a9a27a tempest-VolumesGetTest-507974651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-24d63a8d-682b-4562-9d0a-f6c7085fb06e" returned: 1 in 0.545s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-447d8d98-25e9-43f4-a67e-425de8a9a27a tempest-VolumesGetTest-507974651 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-24d63a8d-682b-4562-9d0a-f6c7085fb06e' failed. Not Retrying. {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 28 04:46:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-447d8d98-25e9-43f4-a67e-425de8a9a27a tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-24d63a8d-682b-4562-9d0a-f6c7085fb06e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:18 devstack sudo[89387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d.5947f9d0-ebf1-4e80-a091-e0b4b8463dba
Feb 28 04:46:18 devstack sudo[89387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:18 devstack sudo[89389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-24d63a8d-682b-4562-9d0a-f6c7085fb06e
Feb 28 04:46:18 devstack sudo[89389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:19 devstack sudo[89389]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-447d8d98-25e9-43f4-a67e-425de8a9a27a tempest-VolumesGetTest-507974651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-24d63a8d-682b-4562-9d0a-f6c7085fb06e" returned: 0 in 0.445s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:19 devstack sudo[89387]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-faa7d942-0d0c-49bc-966a-40ffead1bb26 tempest-VolumesSnapshotNegativeTestJSON-581799033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d.5947f9d0-ebf1-4e80-a091-e0b4b8463dba" returned: 0 in 0.477s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:19 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-447d8d98-25e9-43f4-a67e-425de8a9a27a tempest-VolumesGetTest-507974651 None] Lock "cinder-quobyte-24d63a8d-682b-4562-9d0a-f6c7085fb06e" released by "delete_volume" :: held 1.646s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-faa7d942-0d0c-49bc-966a-40ffead1bb26 tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:19 devstack sudo[89393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d.info
Feb 28 04:46:19 devstack sudo[89393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:19 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-447d8d98-25e9-43f4-a67e-425de8a9a27a tempest-VolumesGetTest-507974651 None] Created reservations ['6d62d0d3-bd28-4a69-bbac-d76bc8725fa1', '75c6dd1e-1178-4ad5-a216-954d6dffa8d8', '39e1ef9c-2cb4-4504-82d8-237c86eee2b0', '8464d3a4-3e9a-4666-836f-3b2094af741a'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:46:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-447d8d98-25e9-43f4-a67e-425de8a9a27a tempest-VolumesGetTest-507974651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-447d8d98-25e9-43f4-a67e-425de8a9a27a tempest-VolumesGetTest-507974651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:19 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-447d8d98-25e9-43f4-a67e-425de8a9a27a tempest-VolumesGetTest-507974651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:46:19 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-447d8d98-25e9-43f4-a67e-425de8a9a27a tempest-VolumesGetTest-507974651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:46:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-447d8d98-25e9-43f4-a67e-425de8a9a27a tempest-VolumesGetTest-507974651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-447d8d98-25e9-43f4-a67e-425de8a9a27a tempest-VolumesGetTest-507974651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:19 devstack sudo[89401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:46:19 devstack sudo[89401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:19 devstack sudo[89393]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-faa7d942-0d0c-49bc-966a-40ffead1bb26 tempest-VolumesSnapshotNegativeTestJSON-581799033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d.info" returned: 0 in 0.442s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:19 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-faa7d942-0d0c-49bc-966a-40ffead1bb26 tempest-VolumesSnapshotNegativeTestJSON-581799033 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d.info is being set with open permissions: ugo+rw
Feb 28 04:46:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-faa7d942-0d0c-49bc-966a-40ffead1bb26 tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:19 devstack sudo[89404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d.info
Feb 28 04:46:19 devstack sudo[89404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:19 devstack sudo[89401]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-447d8d98-25e9-43f4-a67e-425de8a9a27a tempest-VolumesGetTest-507974651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.517s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:19 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-447d8d98-25e9-43f4-a67e-425de8a9a27a tempest-VolumesGetTest-507974651 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:46:19 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-447d8d98-25e9-43f4-a67e-425de8a9a27a tempest-VolumesGetTest-507974651 None] Deleted volume successfully.
Feb 28 04:46:19 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-447d8d98-25e9-43f4-a67e-425de8a9a27a tempest-VolumesGetTest-507974651 None] Lock "cinder-24d63a8d-682b-4562-9d0a-f6c7085fb06e-delete_volume" released by "delete_volume" :: held 2.339s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:20 devstack sudo[89404]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-faa7d942-0d0c-49bc-966a-40ffead1bb26 tempest-VolumesSnapshotNegativeTestJSON-581799033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d.info" returned: 0 in 0.542s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-faa7d942-0d0c-49bc-966a-40ffead1bb26 tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.220s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-280e57f7-9bd0-4b2e-801e-4790e283359d tempest-VolumesTransfersV355Test-358046033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.102s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:20 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-280e57f7-9bd0-4b2e-801e-4790e283359d tempest-VolumesTransfersV355Test-358046033 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:46:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2017590988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45d0a4fa-fc79-4bb6-be82-ae9a2e424e50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ca1a5f63c464c748f458afd4ccfd55f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:46:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:46:18Z,use_quota=True,user_id='dbdbe032a33c4687bc65ce4be0ee0e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:46:20 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-280e57f7-9bd0-4b2e-801e-4790e283359d tempest-VolumesTransfersV355Test-358046033 None] Creating volume 45d0a4fa-fc79-4bb6-be82-ae9a2e424e50 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:46:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-280e57f7-9bd0-4b2e-801e-4790e283359d tempest-VolumesTransfersV355Test-358046033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-280e57f7-9bd0-4b2e-801e-4790e283359d tempest-VolumesTransfersV355Test-358046033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:20 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-280e57f7-9bd0-4b2e-801e-4790e283359d tempest-VolumesTransfersV355Test-358046033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:46:20 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-280e57f7-9bd0-4b2e-801e-4790e283359d tempest-VolumesTransfersV355Test-358046033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:46:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-280e57f7-9bd0-4b2e-801e-4790e283359d tempest-VolumesTransfersV355Test-358046033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:20 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-280e57f7-9bd0-4b2e-801e-4790e283359d tempest-VolumesTransfersV355Test-358046033 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:46:20 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-280e57f7-9bd0-4b2e-801e-4790e283359d tempest-VolumesTransfersV355Test-358046033 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:46:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-280e57f7-9bd0-4b2e-801e-4790e283359d tempest-VolumesTransfersV355Test-358046033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-45d0a4fa-fc79-4bb6-be82-ae9a2e424e50 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:20 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-faa7d942-0d0c-49bc-966a-40ffead1bb26 tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Create snapshot completed successfully
Feb 28 04:46:20 devstack sudo[89409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-45d0a4fa-fc79-4bb6-be82-ae9a2e424e50 1073741824
Feb 28 04:46:20 devstack sudo[89409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:20 devstack sudo[89409]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-280e57f7-9bd0-4b2e-801e-4790e283359d tempest-VolumesTransfersV355Test-358046033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-45d0a4fa-fc79-4bb6-be82-ae9a2e424e50 1073741824" returned: 0 in 0.563s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-280e57f7-9bd0-4b2e-801e-4790e283359d tempest-VolumesTransfersV355Test-358046033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-45d0a4fa-fc79-4bb6-be82-ae9a2e424e50 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:20 devstack sudo[89414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-45d0a4fa-fc79-4bb6-be82-ae9a2e424e50
Feb 28 04:46:20 devstack sudo[89414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:21 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ee7cc573-6735-4f1d-8ffb-6ba1f1e2a1e0 tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Acquiring lock "cinder-5947f9d0-ebf1-4e80-a091-e0b4b8463dba-delete_snapshot" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:21 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ee7cc573-6735-4f1d-8ffb-6ba1f1e2a1e0 tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Lock "cinder-5947f9d0-ebf1-4e80-a091-e0b4b8463dba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:21 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ee7cc573-6735-4f1d-8ffb-6ba1f1e2a1e0 tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Acquiring lock "cinder-quobyte-61914eed-a3fa-463f-8840-b845ac1b618d" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:21 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ee7cc573-6735-4f1d-8ffb-6ba1f1e2a1e0 tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Lock "cinder-quobyte-61914eed-a3fa-463f-8840-b845ac1b618d" acquired by "delete_snapshot" :: waited 0.007s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:21 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ee7cc573-6735-4f1d-8ffb-6ba1f1e2a1e0 tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Acquiring lock "cinder-quobyte-5947f9d0-ebf1-4e80-a091-e0b4b8463dba" by "_delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:21 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ee7cc573-6735-4f1d-8ffb-6ba1f1e2a1e0 tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Lock "cinder-quobyte-5947f9d0-ebf1-4e80-a091-e0b4b8463dba" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:21 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-ee7cc573-6735-4f1d-8ffb-6ba1f1e2a1e0 tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Deleting offline snapshot 5947f9d0-ebf1-4e80-a091-e0b4b8463dba of volume 61914eed-a3fa-463f-8840-b845ac1b618d {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 04:46:21 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-ee7cc573-6735-4f1d-8ffb-6ba1f1e2a1e0 tempest-VolumesSnapshotNegativeTestJSON-581799033 None] snapshot_file for this snap is: volume-61914eed-a3fa-463f-8840-b845ac1b618d.5947f9d0-ebf1-4e80-a091-e0b4b8463dba {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 04:46:21 devstack sudo[89414]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-280e57f7-9bd0-4b2e-801e-4790e283359d tempest-VolumesTransfersV355Test-358046033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-45d0a4fa-fc79-4bb6-be82-ae9a2e424e50" returned: 0 in 0.538s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:21 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-280e57f7-9bd0-4b2e-801e-4790e283359d tempest-VolumesTransfersV355Test-358046033 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:46:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-280e57f7-9bd0-4b2e-801e-4790e283359d tempest-VolumesTransfersV355Test-358046033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:21 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[90704045-a491-43be-ae79-5afbe3d3c3e9]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ee7cc573-6735-4f1d-8ffb-6ba1f1e2a1e0 tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d.5947f9d0-ebf1-4e80-a091-e0b4b8463dba {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:21 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-280e57f7-9bd0-4b2e-801e-4790e283359d tempest-VolumesTransfersV355Test-358046033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ff9bc55-a5fc-46c2-b39c-7bda3fce7320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45d0a4fa-fc79-4bb6-be82-ae9a2e424e50', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:21 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-280e57f7-9bd0-4b2e-801e-4790e283359d tempest-VolumesTransfersV355Test-358046033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f171422f-7cdf-4ba5-a936-d84d4af89564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:21 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-280e57f7-9bd0-4b2e-801e-4790e283359d tempest-VolumesTransfersV355Test-358046033 None] Volume volume-45d0a4fa-fc79-4bb6-be82-ae9a2e424e50 (45d0a4fa-fc79-4bb6-be82-ae9a2e424e50): created successfully
Feb 28 04:46:21 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-280e57f7-9bd0-4b2e-801e-4790e283359d tempest-VolumesTransfersV355Test-358046033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f171422f-7cdf-4ba5-a936-d84d4af89564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:21 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-280e57f7-9bd0-4b2e-801e-4790e283359d tempest-VolumesTransfersV355Test-358046033 None] Flow 'volume_create_manager' (b3829ed6-59d3-4c31-b4c5-c46d57803e49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:46:21 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-280e57f7-9bd0-4b2e-801e-4790e283359d tempest-VolumesTransfersV355Test-358046033 None] Created volume successfully.
Feb 28 04:46:21 devstack sudo[89417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d.5947f9d0-ebf1-4e80-a091-e0b4b8463dba
Feb 28 04:46:21 devstack sudo[89417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:21 devstack sudo[89417]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ee7cc573-6735-4f1d-8ffb-6ba1f1e2a1e0 tempest-VolumesSnapshotNegativeTestJSON-581799033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d.5947f9d0-ebf1-4e80-a091-e0b4b8463dba" returned: 0 in 0.513s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:21 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-ee7cc573-6735-4f1d-8ffb-6ba1f1e2a1e0 tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61914eed-a3fa-463f-8840-b845ac1b618d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:46:21 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf91984-0b3c-4d6d-b8e0-68fb6a7e04b8]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ee7cc573-6735-4f1d-8ffb-6ba1f1e2a1e0 tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:21 devstack sudo[89422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d
Feb 28 04:46:21 devstack sudo[89422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:22 devstack sudo[89422]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ee7cc573-6735-4f1d-8ffb-6ba1f1e2a1e0 tempest-VolumesSnapshotNegativeTestJSON-581799033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d" returned: 0 in 0.606s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ee7cc573-6735-4f1d-8ffb-6ba1f1e2a1e0 tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d.5947f9d0-ebf1-4e80-a091-e0b4b8463dba {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:22 devstack sudo[89427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d.5947f9d0-ebf1-4e80-a091-e0b4b8463dba
Feb 28 04:46:22 devstack sudo[89427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:22 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6b485d8f-8b50-4fb0-8a58-d3e0831d984c tempest-VolumesTransfersV355Test-132225934 None] Acquiring lock "cinder-45d0a4fa-fc79-4bb6-be82-ae9a2e424e50-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:22 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6b485d8f-8b50-4fb0-8a58-d3e0831d984c tempest-VolumesTransfersV355Test-132225934 None] Lock "cinder-45d0a4fa-fc79-4bb6-be82-ae9a2e424e50-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:22 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6b485d8f-8b50-4fb0-8a58-d3e0831d984c tempest-VolumesTransfersV355Test-132225934 None] Acquiring lock "cinder-quobyte-45d0a4fa-fc79-4bb6-be82-ae9a2e424e50" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:22 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6b485d8f-8b50-4fb0-8a58-d3e0831d984c tempest-VolumesTransfersV355Test-132225934 None] Lock "cinder-quobyte-45d0a4fa-fc79-4bb6-be82-ae9a2e424e50" acquired by "delete_volume" :: waited 0.009s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:22 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2c12d9-45a5-4dae-9903-7cd07495fa55]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6b485d8f-8b50-4fb0-8a58-d3e0831d984c tempest-VolumesTransfersV355Test-132225934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-45d0a4fa-fc79-4bb6-be82-ae9a2e424e50 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:22 devstack sudo[89429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-45d0a4fa-fc79-4bb6-be82-ae9a2e424e50
Feb 28 04:46:22 devstack sudo[89429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:23 devstack sudo[89427]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ee7cc573-6735-4f1d-8ffb-6ba1f1e2a1e0 tempest-VolumesSnapshotNegativeTestJSON-581799033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d.5947f9d0-ebf1-4e80-a091-e0b4b8463dba" returned: 0 in 0.577s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ee7cc573-6735-4f1d-8ffb-6ba1f1e2a1e0 tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d.5947f9d0-ebf1-4e80-a091-e0b4b8463dba {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:23 devstack sudo[89434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d.5947f9d0-ebf1-4e80-a091-e0b4b8463dba
Feb 28 04:46:23 devstack sudo[89434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:23 devstack sudo[89429]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6b485d8f-8b50-4fb0-8a58-d3e0831d984c tempest-VolumesTransfersV355Test-132225934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-45d0a4fa-fc79-4bb6-be82-ae9a2e424e50" returned: 0 in 0.568s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6b485d8f-8b50-4fb0-8a58-d3e0831d984c tempest-VolumesTransfersV355Test-132225934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-45d0a4fa-fc79-4bb6-be82-ae9a2e424e50 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:23 devstack sudo[89439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-45d0a4fa-fc79-4bb6-be82-ae9a2e424e50
Feb 28 04:46:23 devstack sudo[89439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:23 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-b49cc105-49ab-4f5c-830a-0a309ee3e554 tempest-VolumesSnapshotListTestJSON-925414587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:46:23 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b49cc105-49ab-4f5c-830a-0a309ee3e554 tempest-VolumesSnapshotListTestJSON-925414587 None] Flow 'volume_create_manager' (becb3b39-694d-45d0-80c7-e5ec12fb0dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:46:23 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b49cc105-49ab-4f5c-830a-0a309ee3e554 tempest-VolumesSnapshotListTestJSON-925414587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (462ec47c-9730-4a39-b169-e2a60551ce5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:23 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b49cc105-49ab-4f5c-830a-0a309ee3e554 tempest-VolumesSnapshotListTestJSON-925414587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (462ec47c-9730-4a39-b169-e2a60551ce5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-690369394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0483b314-d3d9-47ac-b27d-5dfbeaa8911e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76de8940772041cea59279c1e1f0e442',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:46:23Z,use_quota=True,user_id='5570b1d7f57847c6adeceaa888c76051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:23 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b49cc105-49ab-4f5c-830a-0a309ee3e554 tempest-VolumesSnapshotListTestJSON-925414587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (025cd0dd-9f2a-46bf-bfb4-d3b36881189f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:23 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b49cc105-49ab-4f5c-830a-0a309ee3e554 tempest-VolumesSnapshotListTestJSON-925414587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (025cd0dd-9f2a-46bf-bfb4-d3b36881189f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:23 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b49cc105-49ab-4f5c-830a-0a309ee3e554 tempest-VolumesSnapshotListTestJSON-925414587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd02e9e8-4ef3-434a-9c09-49f8dd020c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:23 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b49cc105-49ab-4f5c-830a-0a309ee3e554 tempest-VolumesSnapshotListTestJSON-925414587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd02e9e8-4ef3-434a-9c09-49f8dd020c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0483b314-d3d9-47ac-b27d-5dfbeaa8911e', 'volume_name': 'volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:23 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b49cc105-49ab-4f5c-830a-0a309ee3e554 tempest-VolumesSnapshotListTestJSON-925414587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ee9001-2512-4a1b-9b7c-381bd4995770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:23 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b49cc105-49ab-4f5c-830a-0a309ee3e554 tempest-VolumesSnapshotListTestJSON-925414587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ee9001-2512-4a1b-9b7c-381bd4995770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:23 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b49cc105-49ab-4f5c-830a-0a309ee3e554 tempest-VolumesSnapshotListTestJSON-925414587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a7ed5f9-6dd9-4743-a062-861ff842989b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:23 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-b49cc105-49ab-4f5c-830a-0a309ee3e554 tempest-VolumesSnapshotListTestJSON-925414587 None] Volume 0483b314-d3d9-47ac-b27d-5dfbeaa8911e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e', 'volume_size': 1}
Feb 28 04:46:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b49cc105-49ab-4f5c-830a-0a309ee3e554 tempest-VolumesSnapshotListTestJSON-925414587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b49cc105-49ab-4f5c-830a-0a309ee3e554 tempest-VolumesSnapshotListTestJSON-925414587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:23 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-b49cc105-49ab-4f5c-830a-0a309ee3e554 tempest-VolumesSnapshotListTestJSON-925414587 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-690369394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0483b314-d3d9-47ac-b27d-5dfbeaa8911e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76de8940772041cea59279c1e1f0e442',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:46:23Z,use_quota=True,user_id='5570b1d7f57847c6adeceaa888c76051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:46:23 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-b49cc105-49ab-4f5c-830a-0a309ee3e554 tempest-VolumesSnapshotListTestJSON-925414587 None] Creating volume 0483b314-d3d9-47ac-b27d-5dfbeaa8911e {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:46:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b49cc105-49ab-4f5c-830a-0a309ee3e554 tempest-VolumesSnapshotListTestJSON-925414587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b49cc105-49ab-4f5c-830a-0a309ee3e554 tempest-VolumesSnapshotListTestJSON-925414587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:23 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-b49cc105-49ab-4f5c-830a-0a309ee3e554 tempest-VolumesSnapshotListTestJSON-925414587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:46:23 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-b49cc105-49ab-4f5c-830a-0a309ee3e554 tempest-VolumesSnapshotListTestJSON-925414587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:46:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b49cc105-49ab-4f5c-830a-0a309ee3e554 tempest-VolumesSnapshotListTestJSON-925414587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:23 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-b49cc105-49ab-4f5c-830a-0a309ee3e554 tempest-VolumesSnapshotListTestJSON-925414587 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:46:23 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-b49cc105-49ab-4f5c-830a-0a309ee3e554 tempest-VolumesSnapshotListTestJSON-925414587 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:46:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b49cc105-49ab-4f5c-830a-0a309ee3e554 tempest-VolumesSnapshotListTestJSON-925414587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:23 devstack sudo[89441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e 1073741824
Feb 28 04:46:23 devstack sudo[89441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:23 devstack sudo[89434]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ee7cc573-6735-4f1d-8ffb-6ba1f1e2a1e0 tempest-VolumesSnapshotNegativeTestJSON-581799033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d.5947f9d0-ebf1-4e80-a091-e0b4b8463dba" returned: 0 in 0.466s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:23 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ee7cc573-6735-4f1d-8ffb-6ba1f1e2a1e0 tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Lock "cinder-quobyte-5947f9d0-ebf1-4e80-a091-e0b4b8463dba" released by "_delete_snapshot" :: held 2.231s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:23 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ee7cc573-6735-4f1d-8ffb-6ba1f1e2a1e0 tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Lock "cinder-quobyte-61914eed-a3fa-463f-8840-b845ac1b618d" released by "delete_snapshot" :: held 2.262s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:23 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-ee7cc573-6735-4f1d-8ffb-6ba1f1e2a1e0 tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Created reservations ['689e0d24-fa7c-4664-9a0a-c7e548dbc32f', '5f3a788b-e74e-46cb-bf93-ef4c0ddf13d6', '8ba1a97a-14c8-4b82-8b18-6a115069a5a2', '061bfeac-cefb-438b-94cb-30cd59a2fb64'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:46:23 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-ee7cc573-6735-4f1d-8ffb-6ba1f1e2a1e0 tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Delete snapshot completed successfully.
Feb 28 04:46:23 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ee7cc573-6735-4f1d-8ffb-6ba1f1e2a1e0 tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Lock "cinder-5947f9d0-ebf1-4e80-a091-e0b4b8463dba-delete_snapshot" released by "delete_snapshot" :: held 2.339s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:23 devstack sudo[89439]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6b485d8f-8b50-4fb0-8a58-d3e0831d984c tempest-VolumesTransfersV355Test-132225934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-45d0a4fa-fc79-4bb6-be82-ae9a2e424e50" returned: 0 in 0.478s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:23 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6b485d8f-8b50-4fb0-8a58-d3e0831d984c tempest-VolumesTransfersV355Test-132225934 None] Lock "cinder-quobyte-45d0a4fa-fc79-4bb6-be82-ae9a2e424e50" released by "delete_volume" :: held 1.075s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:23 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-6b485d8f-8b50-4fb0-8a58-d3e0831d984c tempest-VolumesTransfersV355Test-132225934 None] Created reservations ['ffcd91d2-8d16-4cca-b88e-b89f9bf28ce8', 'e5860efd-373b-4bbb-ab56-fe3d33e5b842', '5a0c3713-1319-4e6c-aaa1-99b19b85a3d4', '0158aa3e-6e9e-4df6-bf03-8a55acf77477'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:46:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-6b485d8f-8b50-4fb0-8a58-d3e0831d984c tempest-VolumesTransfersV355Test-132225934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-6b485d8f-8b50-4fb0-8a58-d3e0831d984c tempest-VolumesTransfersV355Test-132225934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:23 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-6b485d8f-8b50-4fb0-8a58-d3e0831d984c tempest-VolumesTransfersV355Test-132225934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:46:23 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-6b485d8f-8b50-4fb0-8a58-d3e0831d984c tempest-VolumesTransfersV355Test-132225934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:46:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-6b485d8f-8b50-4fb0-8a58-d3e0831d984c tempest-VolumesTransfersV355Test-132225934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6b485d8f-8b50-4fb0-8a58-d3e0831d984c tempest-VolumesTransfersV355Test-132225934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:23 devstack sudo[89448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:46:23 devstack sudo[89448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:23 devstack sudo[89441]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b49cc105-49ab-4f5c-830a-0a309ee3e554 tempest-VolumesSnapshotListTestJSON-925414587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e 1073741824" returned: 0 in 0.513s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b49cc105-49ab-4f5c-830a-0a309ee3e554 tempest-VolumesSnapshotListTestJSON-925414587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:23 devstack sudo[89450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e
Feb 28 04:46:23 devstack sudo[89450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:24 devstack sudo[89448]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6b485d8f-8b50-4fb0-8a58-d3e0831d984c tempest-VolumesTransfersV355Test-132225934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.420s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:24 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-6b485d8f-8b50-4fb0-8a58-d3e0831d984c tempest-VolumesTransfersV355Test-132225934 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:46:24 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-6b485d8f-8b50-4fb0-8a58-d3e0831d984c tempest-VolumesTransfersV355Test-132225934 None] Deleted volume successfully.
Feb 28 04:46:24 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6b485d8f-8b50-4fb0-8a58-d3e0831d984c tempest-VolumesTransfersV355Test-132225934 None] Lock "cinder-45d0a4fa-fc79-4bb6-be82-ae9a2e424e50-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:24 devstack sudo[89450]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b49cc105-49ab-4f5c-830a-0a309ee3e554 tempest-VolumesSnapshotListTestJSON-925414587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e" returned: 0 in 0.439s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:24 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-b49cc105-49ab-4f5c-830a-0a309ee3e554 tempest-VolumesSnapshotListTestJSON-925414587 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:46:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b49cc105-49ab-4f5c-830a-0a309ee3e554 tempest-VolumesSnapshotListTestJSON-925414587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:24 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b49cc105-49ab-4f5c-830a-0a309ee3e554 tempest-VolumesSnapshotListTestJSON-925414587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a7ed5f9-6dd9-4743-a062-861ff842989b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:24 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b49cc105-49ab-4f5c-830a-0a309ee3e554 tempest-VolumesSnapshotListTestJSON-925414587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (115b4e6a-b71a-41d8-b7f5-5a0d8b698576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:24 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-b49cc105-49ab-4f5c-830a-0a309ee3e554 tempest-VolumesSnapshotListTestJSON-925414587 None] Volume volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e (0483b314-d3d9-47ac-b27d-5dfbeaa8911e): created successfully
Feb 28 04:46:24 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b49cc105-49ab-4f5c-830a-0a309ee3e554 tempest-VolumesSnapshotListTestJSON-925414587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (115b4e6a-b71a-41d8-b7f5-5a0d8b698576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:24 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b49cc105-49ab-4f5c-830a-0a309ee3e554 tempest-VolumesSnapshotListTestJSON-925414587 None] Flow 'volume_create_manager' (becb3b39-694d-45d0-80c7-e5ec12fb0dc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:46:24 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-b49cc105-49ab-4f5c-830a-0a309ee3e554 tempest-VolumesSnapshotListTestJSON-925414587 None] Created volume successfully.
Feb 28 04:46:24 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-10764db3-8237-4d74-8993-96177f20a6ef tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Acquiring lock "cinder-61914eed-a3fa-463f-8840-b845ac1b618d-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:24 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-10764db3-8237-4d74-8993-96177f20a6ef tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Lock "cinder-61914eed-a3fa-463f-8840-b845ac1b618d-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:24 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-10764db3-8237-4d74-8993-96177f20a6ef tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Acquiring lock "cinder-quobyte-61914eed-a3fa-463f-8840-b845ac1b618d" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:24 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-10764db3-8237-4d74-8993-96177f20a6ef tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Lock "cinder-quobyte-61914eed-a3fa-463f-8840-b845ac1b618d" acquired by "delete_volume" :: waited 0.010s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:24 devstack cinder-volume[84248]: DEBUG oslo_service.periodic_task [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84248) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 28 04:46:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:24 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:46:24 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:46:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:24 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98f4973-2328-4079-b48c-6a7935dda003]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-10764db3-8237-4d74-8993-96177f20a6ef tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:24 devstack sudo[89455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:46:24 devstack sudo[89455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:24 devstack sudo[89456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d
Feb 28 04:46:24 devstack sudo[89456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:25 devstack sudo[89455]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.482s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:25 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:46:25 devstack sudo[89456]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-10764db3-8237-4d74-8993-96177f20a6ef tempest-VolumesSnapshotNegativeTestJSON-581799033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d" returned: 0 in 0.583s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-10764db3-8237-4d74-8993-96177f20a6ef tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:25 devstack sudo[89463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d
Feb 28 04:46:25 devstack sudo[89463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-4dd1c9ba-c160-4127-8ae0-62678453f5f2 tempest-VolumesSnapshotListTestJSON-925414587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-4dd1c9ba-c160-4127-8ae0-62678453f5f2 tempest-VolumesSnapshotListTestJSON-925414587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:25 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-4dd1c9ba-c160-4127-8ae0-62678453f5f2 tempest-VolumesSnapshotListTestJSON-925414587 None] Creating offline snapshot 2ca963f8-57f3-4857-9299-9c01b37bfbe2 of volume 0483b314-d3d9-47ac-b27d-5dfbeaa8911e {{(pid=84248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 04:46:25 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabbde9d-2a18-41dd-8560-84fe4180b8d5]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4dd1c9ba-c160-4127-8ae0-62678453f5f2 tempest-VolumesSnapshotListTestJSON-925414587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:25 devstack sudo[89465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e
Feb 28 04:46:25 devstack sudo[89465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:25 devstack sudo[89463]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-10764db3-8237-4d74-8993-96177f20a6ef tempest-VolumesSnapshotNegativeTestJSON-581799033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61914eed-a3fa-463f-8840-b845ac1b618d" returned: 0 in 0.598s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:25 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-10764db3-8237-4d74-8993-96177f20a6ef tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Lock "cinder-quobyte-61914eed-a3fa-463f-8840-b845ac1b618d" released by "delete_volume" :: held 1.228s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:25 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-10764db3-8237-4d74-8993-96177f20a6ef tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Created reservations ['dc221928-2968-4d29-af47-c510f18e6723', 'e7db5e7f-80f7-4538-91e6-df9837658231', '0f2fadc0-2693-4dd6-8c57-c5063a33bac4', '26c1604a-7798-4f93-81a5-05b2f452f523'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:46:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-10764db3-8237-4d74-8993-96177f20a6ef tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-10764db3-8237-4d74-8993-96177f20a6ef tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:25 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-10764db3-8237-4d74-8993-96177f20a6ef tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:46:25 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-10764db3-8237-4d74-8993-96177f20a6ef tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:46:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-10764db3-8237-4d74-8993-96177f20a6ef tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-10764db3-8237-4d74-8993-96177f20a6ef tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:25 devstack sudo[89468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:46:25 devstack sudo[89468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:26 devstack sudo[89465]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4dd1c9ba-c160-4127-8ae0-62678453f5f2 tempest-VolumesSnapshotListTestJSON-925414587 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e" returned: 0 in 0.657s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4dd1c9ba-c160-4127-8ae0-62678453f5f2 tempest-VolumesSnapshotListTestJSON-925414587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.2ca963f8-57f3-4857-9299-9c01b37bfbe2 1G {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:26 devstack sudo[89473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.2ca963f8-57f3-4857-9299-9c01b37bfbe2 1G
Feb 28 04:46:26 devstack sudo[89473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:26 devstack sudo[89468]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-10764db3-8237-4d74-8993-96177f20a6ef tempest-VolumesSnapshotNegativeTestJSON-581799033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.477s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:26 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-10764db3-8237-4d74-8993-96177f20a6ef tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:46:26 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-10764db3-8237-4d74-8993-96177f20a6ef tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Deleted volume successfully.
Feb 28 04:46:26 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-10764db3-8237-4d74-8993-96177f20a6ef tempest-VolumesSnapshotNegativeTestJSON-581799033 None] Lock "cinder-61914eed-a3fa-463f-8840-b845ac1b618d-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:26 devstack sudo[89473]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4dd1c9ba-c160-4127-8ae0-62678453f5f2 tempest-VolumesSnapshotListTestJSON-925414587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.2ca963f8-57f3-4857-9299-9c01b37bfbe2 1G" returned: 0 in 0.629s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4dd1c9ba-c160-4127-8ae0-62678453f5f2 tempest-VolumesSnapshotListTestJSON-925414587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.2ca963f8-57f3-4857-9299-9c01b37bfbe2 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:26 devstack sudo[89479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.2ca963f8-57f3-4857-9299-9c01b37bfbe2
Feb 28 04:46:26 devstack sudo[89479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:27 devstack sudo[89479]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:27 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4dd1c9ba-c160-4127-8ae0-62678453f5f2 tempest-VolumesSnapshotListTestJSON-925414587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.2ca963f8-57f3-4857-9299-9c01b37bfbe2" returned: 0 in 0.506s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:27 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-4dd1c9ba-c160-4127-8ae0-62678453f5f2 tempest-VolumesSnapshotListTestJSON-925414587 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.2ca963f8-57f3-4857-9299-9c01b37bfbe2 is being set with open permissions: ugo+rw
Feb 28 04:46:27 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4dd1c9ba-c160-4127-8ae0-62678453f5f2 tempest-VolumesSnapshotListTestJSON-925414587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.2ca963f8-57f3-4857-9299-9c01b37bfbe2 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:27 devstack sudo[89484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.2ca963f8-57f3-4857-9299-9c01b37bfbe2
Feb 28 04:46:27 devstack sudo[89484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:27 devstack sudo[89484]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:27 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4dd1c9ba-c160-4127-8ae0-62678453f5f2 tempest-VolumesSnapshotListTestJSON-925414587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.2ca963f8-57f3-4857-9299-9c01b37bfbe2" returned: 0 in 0.532s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:27 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4dd1c9ba-c160-4127-8ae0-62678453f5f2 tempest-VolumesSnapshotListTestJSON-925414587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:27 devstack sudo[89487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.info
Feb 28 04:46:27 devstack sudo[89487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:28 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ea07350-c345-4d78-8217-473a9a17d743 tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:46:28 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-0ea07350-c345-4d78-8217-473a9a17d743 tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Flow 'volume_create_manager' (5b6a8dbb-67f5-41e6-a429-1d353e276ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:46:28 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-0ea07350-c345-4d78-8217-473a9a17d743 tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daa79da7-158c-4c58-b0bf-d2893a46a137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:28 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-0ea07350-c345-4d78-8217-473a9a17d743 tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daa79da7-158c-4c58-b0bf-d2893a46a137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-3414622',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aa53b74-7ed4-4a2e-ade6-d2497cb5dfe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57928e0ce7c1421da47b154756cb6a3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:46:28Z,use_quota=True,user_id='6b47e1780d46447f9437d3e612dcbf77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27880f7d-0320-4713-807b-60748dcbfb7c),volume_type_id=27880f7d-0320-4713-807b-60748dcbfb7c)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:28 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-0ea07350-c345-4d78-8217-473a9a17d743 tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74922222-da32-49b4-bce1-05763b78e5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:28 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-0ea07350-c345-4d78-8217-473a9a17d743 tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74922222-da32-49b4-bce1-05763b78e5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:28 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-0ea07350-c345-4d78-8217-473a9a17d743 tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da508184-5201-4f37-a6a8-98737dc1baea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:28 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-0ea07350-c345-4d78-8217-473a9a17d743 tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da508184-5201-4f37-a6a8-98737dc1baea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2aa53b74-7ed4-4a2e-ade6-d2497cb5dfe9', 'volume_name': 'volume-2aa53b74-7ed4-4a2e-ade6-d2497cb5dfe9', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:28 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-0ea07350-c345-4d78-8217-473a9a17d743 tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5af6327-f856-4afb-bdcf-13c67e0f96b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:28 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-0ea07350-c345-4d78-8217-473a9a17d743 tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5af6327-f856-4afb-bdcf-13c67e0f96b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:28 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-0ea07350-c345-4d78-8217-473a9a17d743 tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98690bbb-d5d6-4ee2-b9ba-2323554152f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:28 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-0ea07350-c345-4d78-8217-473a9a17d743 tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Volume 2aa53b74-7ed4-4a2e-ade6-d2497cb5dfe9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2aa53b74-7ed4-4a2e-ade6-d2497cb5dfe9', 'volume_size': 1}
Feb 28 04:46:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-0ea07350-c345-4d78-8217-473a9a17d743 tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:28 devstack sudo[89487]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4dd1c9ba-c160-4127-8ae0-62678453f5f2 tempest-VolumesSnapshotListTestJSON-925414587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.info" returned: 0 in 0.507s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:28 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-4dd1c9ba-c160-4127-8ae0-62678453f5f2 tempest-VolumesSnapshotListTestJSON-925414587 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.info is being set with open permissions: ugo+rw
Feb 28 04:46:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4dd1c9ba-c160-4127-8ae0-62678453f5f2 tempest-VolumesSnapshotListTestJSON-925414587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:28 devstack sudo[89490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.info
Feb 28 04:46:28 devstack sudo[89490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:28 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9067eb2-f429-4bf5-b625-d9c608555576 tempest-VolumeDependencyTests-162807668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:46:28 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b9067eb2-f429-4bf5-b625-d9c608555576 tempest-VolumeDependencyTests-162807668 None] Flow 'volume_create_manager' (1e970857-142f-405f-b290-b599ae24829c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:46:28 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b9067eb2-f429-4bf5-b625-d9c608555576 tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c5d53b2-0a02-4054-9bbb-00db6d65cc4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:28 devstack sudo[89490]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:28 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b9067eb2-f429-4bf5-b625-d9c608555576 tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c5d53b2-0a02-4054-9bbb-00db6d65cc4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-224796369',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19daf867-ea37-47be-b996-2f63864e2d72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f43d0cbb6ae04f61a534ccddb799a55a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:46:29Z,use_quota=True,user_id='08fd9f1d4efd4e3e98df0bea509eb225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:28 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b9067eb2-f429-4bf5-b625-d9c608555576 tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7528e328-01f3-40dd-abc5-913e6b983130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:28 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b9067eb2-f429-4bf5-b625-d9c608555576 tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7528e328-01f3-40dd-abc5-913e6b983130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:28 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b9067eb2-f429-4bf5-b625-d9c608555576 tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da0745a8-2ad7-4fe5-987b-0956f7ae97be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:28 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b9067eb2-f429-4bf5-b625-d9c608555576 tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da0745a8-2ad7-4fe5-987b-0956f7ae97be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19daf867-ea37-47be-b996-2f63864e2d72', 'volume_name': 'volume-19daf867-ea37-47be-b996-2f63864e2d72', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:28 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b9067eb2-f429-4bf5-b625-d9c608555576 tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (860d1c0c-19e5-4052-89dc-514246adea2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:28 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b9067eb2-f429-4bf5-b625-d9c608555576 tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (860d1c0c-19e5-4052-89dc-514246adea2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:28 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b9067eb2-f429-4bf5-b625-d9c608555576 tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb843c82-ca3f-4678-82e0-03323ec41eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:28 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-b9067eb2-f429-4bf5-b625-d9c608555576 tempest-VolumeDependencyTests-162807668 None] Volume 19daf867-ea37-47be-b996-2f63864e2d72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19daf867-ea37-47be-b996-2f63864e2d72', 'volume_size': 1}
Feb 28 04:46:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b9067eb2-f429-4bf5-b625-d9c608555576 tempest-VolumeDependencyTests-162807668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4dd1c9ba-c160-4127-8ae0-62678453f5f2 tempest-VolumesSnapshotListTestJSON-925414587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.info" returned: 0 in 0.561s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-4dd1c9ba-c160-4127-8ae0-62678453f5f2 tempest-VolumesSnapshotListTestJSON-925414587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.469s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-0ea07350-c345-4d78-8217-473a9a17d743 tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.712s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:28 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-0ea07350-c345-4d78-8217-473a9a17d743 tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-3414622',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aa53b74-7ed4-4a2e-ade6-d2497cb5dfe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57928e0ce7c1421da47b154756cb6a3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:46:28Z,use_quota=True,user_id='6b47e1780d46447f9437d3e612dcbf77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27880f7d-0320-4713-807b-60748dcbfb7c),volume_type_id=27880f7d-0320-4713-807b-60748dcbfb7c)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:46:28 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-0ea07350-c345-4d78-8217-473a9a17d743 tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Creating volume 2aa53b74-7ed4-4a2e-ade6-d2497cb5dfe9 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:46:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-0ea07350-c345-4d78-8217-473a9a17d743 tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-0ea07350-c345-4d78-8217-473a9a17d743 tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:28 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-0ea07350-c345-4d78-8217-473a9a17d743 tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:46:28 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-0ea07350-c345-4d78-8217-473a9a17d743 tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:46:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-0ea07350-c345-4d78-8217-473a9a17d743 tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:29 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-0ea07350-c345-4d78-8217-473a9a17d743 tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:46:29 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-0ea07350-c345-4d78-8217-473a9a17d743 tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:46:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-0ea07350-c345-4d78-8217-473a9a17d743 tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2aa53b74-7ed4-4a2e-ade6-d2497cb5dfe9 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:29 devstack sudo[89493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2aa53b74-7ed4-4a2e-ade6-d2497cb5dfe9 1073741824
Feb 28 04:46:29 devstack sudo[89493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:29 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-4dd1c9ba-c160-4127-8ae0-62678453f5f2 tempest-VolumesSnapshotListTestJSON-925414587 None] Create snapshot completed successfully
Feb 28 04:46:29 devstack sudo[89493]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-0ea07350-c345-4d78-8217-473a9a17d743 tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2aa53b74-7ed4-4a2e-ade6-d2497cb5dfe9 1073741824" returned: 0 in 0.540s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-0ea07350-c345-4d78-8217-473a9a17d743 tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2aa53b74-7ed4-4a2e-ade6-d2497cb5dfe9 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:29 devstack sudo[89498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2aa53b74-7ed4-4a2e-ade6-d2497cb5dfe9
Feb 28 04:46:29 devstack sudo[89498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b27bd8ba-8358-4912-b1da-1d034699048c tempest-VolumesSnapshotListTestJSON-925414587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:29 devstack sudo[89498]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-0ea07350-c345-4d78-8217-473a9a17d743 tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2aa53b74-7ed4-4a2e-ade6-d2497cb5dfe9" returned: 0 in 0.391s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:29 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-0ea07350-c345-4d78-8217-473a9a17d743 tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:46:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-0ea07350-c345-4d78-8217-473a9a17d743 tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b9067eb2-f429-4bf5-b625-d9c608555576 tempest-VolumeDependencyTests-162807668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.990s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:29 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-b9067eb2-f429-4bf5-b625-d9c608555576 tempest-VolumeDependencyTests-162807668 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-224796369',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19daf867-ea37-47be-b996-2f63864e2d72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f43d0cbb6ae04f61a534ccddb799a55a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:46:29Z,use_quota=True,user_id='08fd9f1d4efd4e3e98df0bea509eb225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:46:29 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-b9067eb2-f429-4bf5-b625-d9c608555576 tempest-VolumeDependencyTests-162807668 None] Creating volume 19daf867-ea37-47be-b996-2f63864e2d72 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:46:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b9067eb2-f429-4bf5-b625-d9c608555576 tempest-VolumeDependencyTests-162807668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b9067eb2-f429-4bf5-b625-d9c608555576 tempest-VolumeDependencyTests-162807668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:29 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-b9067eb2-f429-4bf5-b625-d9c608555576 tempest-VolumeDependencyTests-162807668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:46:29 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-b9067eb2-f429-4bf5-b625-d9c608555576 tempest-VolumeDependencyTests-162807668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:46:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b9067eb2-f429-4bf5-b625-d9c608555576 tempest-VolumeDependencyTests-162807668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:29 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-b9067eb2-f429-4bf5-b625-d9c608555576 tempest-VolumeDependencyTests-162807668 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:46:29 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-b9067eb2-f429-4bf5-b625-d9c608555576 tempest-VolumeDependencyTests-162807668 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:46:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b9067eb2-f429-4bf5-b625-d9c608555576 tempest-VolumeDependencyTests-162807668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-0ea07350-c345-4d78-8217-473a9a17d743 tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98690bbb-d5d6-4ee2-b9ba-2323554152f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2aa53b74-7ed4-4a2e-ade6-d2497cb5dfe9', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:29 devstack sudo[89502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72 1073741824
Feb 28 04:46:29 devstack sudo[89502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:30 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-0ea07350-c345-4d78-8217-473a9a17d743 tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2634cf5-8060-4cf7-9bf2-d3a7f2b888b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:30 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-0ea07350-c345-4d78-8217-473a9a17d743 tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Volume volume-2aa53b74-7ed4-4a2e-ade6-d2497cb5dfe9 (2aa53b74-7ed4-4a2e-ade6-d2497cb5dfe9): created successfully
Feb 28 04:46:30 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-0ea07350-c345-4d78-8217-473a9a17d743 tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2634cf5-8060-4cf7-9bf2-d3a7f2b888b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:30 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-0ea07350-c345-4d78-8217-473a9a17d743 tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Flow 'volume_create_manager' (5b6a8dbb-67f5-41e6-a429-1d353e276ddb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:46:30 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-0ea07350-c345-4d78-8217-473a9a17d743 tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Created volume successfully.
Feb 28 04:46:30 devstack sudo[89502]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b9067eb2-f429-4bf5-b625-d9c608555576 tempest-VolumeDependencyTests-162807668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72 1073741824" returned: 0 in 0.547s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b9067eb2-f429-4bf5-b625-d9c608555576 tempest-VolumeDependencyTests-162807668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:30 devstack sudo[89507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72
Feb 28 04:46:30 devstack sudo[89507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-2286913d-b9b2-4f91-930a-c4ca891298da tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-2286913d-b9b2-4f91-930a-c4ca891298da tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:30 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-2286913d-b9b2-4f91-930a-c4ca891298da tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:46:30 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-2286913d-b9b2-4f91-930a-c4ca891298da tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:46:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-2286913d-b9b2-4f91-930a-c4ca891298da tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-2286913d-b9b2-4f91-930a-c4ca891298da tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:30 devstack sudo[89509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:46:30 devstack sudo[89509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:30 devstack sudo[89507]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b9067eb2-f429-4bf5-b625-d9c608555576 tempest-VolumeDependencyTests-162807668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72" returned: 0 in 0.461s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:31 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-b9067eb2-f429-4bf5-b625-d9c608555576 tempest-VolumeDependencyTests-162807668 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:46:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b9067eb2-f429-4bf5-b625-d9c608555576 tempest-VolumeDependencyTests-162807668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b27bd8ba-8358-4912-b1da-1d034699048c tempest-VolumesSnapshotListTestJSON-925414587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.218s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:31 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b9067eb2-f429-4bf5-b625-d9c608555576 tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb843c82-ca3f-4678-82e0-03323ec41eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19daf867-ea37-47be-b996-2f63864e2d72', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:31 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b9067eb2-f429-4bf5-b625-d9c608555576 tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2736c1ec-3584-481c-a83d-505c3fdae6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:31 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-b27bd8ba-8358-4912-b1da-1d034699048c tempest-VolumesSnapshotListTestJSON-925414587 None] Creating offline snapshot 7994f0b2-008d-4241-aebd-1e41855e67cf of volume 0483b314-d3d9-47ac-b27d-5dfbeaa8911e {{(pid=84248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 04:46:31 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-b9067eb2-f429-4bf5-b625-d9c608555576 tempest-VolumeDependencyTests-162807668 None] Volume volume-19daf867-ea37-47be-b996-2f63864e2d72 (19daf867-ea37-47be-b996-2f63864e2d72): created successfully
Feb 28 04:46:31 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b9067eb2-f429-4bf5-b625-d9c608555576 tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2736c1ec-3584-481c-a83d-505c3fdae6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:31 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b9067eb2-f429-4bf5-b625-d9c608555576 tempest-VolumeDependencyTests-162807668 None] Flow 'volume_create_manager' (1e970857-142f-405f-b290-b599ae24829c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:46:31 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[a762a5b0-5c84-4446-86bd-0043ee2243fb]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b27bd8ba-8358-4912-b1da-1d034699048c tempest-VolumesSnapshotListTestJSON-925414587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.2ca963f8-57f3-4857-9299-9c01b37bfbe2 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:31 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-b9067eb2-f429-4bf5-b625-d9c608555576 tempest-VolumeDependencyTests-162807668 None] Created volume successfully.
Feb 28 04:46:31 devstack sudo[89509]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-2286913d-b9b2-4f91-930a-c4ca891298da tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.504s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:31 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-2286913d-b9b2-4f91-930a-c4ca891298da tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:46:31 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-2286913d-b9b2-4f91-930a-c4ca891298da tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Retype volume completed successfully.
Feb 28 04:46:31 devstack sudo[89513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.2ca963f8-57f3-4857-9299-9c01b37bfbe2
Feb 28 04:46:31 devstack sudo[89513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:31 devstack sudo[89513]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b27bd8ba-8358-4912-b1da-1d034699048c tempest-VolumesSnapshotListTestJSON-925414587 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.2ca963f8-57f3-4857-9299-9c01b37bfbe2" returned: 0 in 0.462s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:31 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-b27bd8ba-8358-4912-b1da-1d034699048c tempest-VolumesSnapshotListTestJSON-925414587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:46:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b27bd8ba-8358-4912-b1da-1d034699048c tempest-VolumesSnapshotListTestJSON-925414587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.2ca963f8-57f3-4857-9299-9c01b37bfbe2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.7994f0b2-008d-4241-aebd-1e41855e67cf 1G {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:31 devstack sudo[89518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.2ca963f8-57f3-4857-9299-9c01b37bfbe2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.7994f0b2-008d-4241-aebd-1e41855e67cf 1G
Feb 28 04:46:31 devstack sudo[89518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:31 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-0978847b-619e-460a-86fc-19f5da5f773f tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Acquiring lock "cinder-2aa53b74-7ed4-4a2e-ade6-d2497cb5dfe9-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:31 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-0978847b-619e-460a-86fc-19f5da5f773f tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Lock "cinder-2aa53b74-7ed4-4a2e-ade6-d2497cb5dfe9-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:31 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-0978847b-619e-460a-86fc-19f5da5f773f tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Acquiring lock "cinder-quobyte-2aa53b74-7ed4-4a2e-ade6-d2497cb5dfe9" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:31 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-0978847b-619e-460a-86fc-19f5da5f773f tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Lock "cinder-quobyte-2aa53b74-7ed4-4a2e-ade6-d2497cb5dfe9" acquired by "delete_volume" :: waited 0.007s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:31 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[69701ca1-ea3e-4ade-adf8-6e6e39c87c13]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-0978847b-619e-460a-86fc-19f5da5f773f tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2aa53b74-7ed4-4a2e-ade6-d2497cb5dfe9 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:31 devstack sudo[89520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2aa53b74-7ed4-4a2e-ade6-d2497cb5dfe9
Feb 28 04:46:31 devstack sudo[89520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-6c2aad14-29cc-4c77-a0f1-6d87e2f7cc3f tempest-VolumeDependencyTests-162807668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:32 devstack sudo[89518]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b27bd8ba-8358-4912-b1da-1d034699048c tempest-VolumesSnapshotListTestJSON-925414587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.2ca963f8-57f3-4857-9299-9c01b37bfbe2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.7994f0b2-008d-4241-aebd-1e41855e67cf 1G" returned: 0 in 0.728s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b27bd8ba-8358-4912-b1da-1d034699048c tempest-VolumesSnapshotListTestJSON-925414587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.2ca963f8-57f3-4857-9299-9c01b37bfbe2 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.7994f0b2-008d-4241-aebd-1e41855e67cf {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:32 devstack sudo[89525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.2ca963f8-57f3-4857-9299-9c01b37bfbe2 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.7994f0b2-008d-4241-aebd-1e41855e67cf
Feb 28 04:46:32 devstack sudo[89525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:32 devstack sudo[89520]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-0978847b-619e-460a-86fc-19f5da5f773f tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2aa53b74-7ed4-4a2e-ade6-d2497cb5dfe9" returned: 0 in 0.642s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-0978847b-619e-460a-86fc-19f5da5f773f tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2aa53b74-7ed4-4a2e-ade6-d2497cb5dfe9 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:32 devstack sudo[89530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2aa53b74-7ed4-4a2e-ade6-d2497cb5dfe9
Feb 28 04:46:32 devstack sudo[89530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:32 devstack sudo[89525]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b27bd8ba-8358-4912-b1da-1d034699048c tempest-VolumesSnapshotListTestJSON-925414587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.2ca963f8-57f3-4857-9299-9c01b37bfbe2 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.7994f0b2-008d-4241-aebd-1e41855e67cf" returned: 0 in 0.481s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:32 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-b27bd8ba-8358-4912-b1da-1d034699048c tempest-VolumesSnapshotListTestJSON-925414587 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.7994f0b2-008d-4241-aebd-1e41855e67cf is being set with open permissions: ugo+rw
Feb 28 04:46:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b27bd8ba-8358-4912-b1da-1d034699048c tempest-VolumesSnapshotListTestJSON-925414587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.7994f0b2-008d-4241-aebd-1e41855e67cf {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:32 devstack sudo[89535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.7994f0b2-008d-4241-aebd-1e41855e67cf
Feb 28 04:46:32 devstack sudo[89535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:32 devstack sudo[89530]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-0978847b-619e-460a-86fc-19f5da5f773f tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-2aa53b74-7ed4-4a2e-ade6-d2497cb5dfe9" returned: 0 in 0.457s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:32 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-0978847b-619e-460a-86fc-19f5da5f773f tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Lock "cinder-quobyte-2aa53b74-7ed4-4a2e-ade6-d2497cb5dfe9" released by "delete_volume" :: held 1.122s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:32 devstack cinder-volume[84248]: WARNING cinder.quota [None req-0978847b-619e-460a-86fc-19f5da5f773f tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Feb 28 04:46:32 devstack cinder-volume[84248]: WARNING cinder.quota [None req-0978847b-619e-460a-86fc-19f5da5f773f tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Feb 28 04:46:33 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-0978847b-619e-460a-86fc-19f5da5f773f tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Created reservations ['c68b374b-cc79-4ef7-9b95-2c56e4a05919', '6594fc3d-96bc-4e83-a46f-84a188f4768c', '40224c71-2165-4816-85ed-d4fe5dfb9446', '1e3dab35-b94d-4a7b-85a0-d20af88840cd'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:46:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-0978847b-619e-460a-86fc-19f5da5f773f tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-0978847b-619e-460a-86fc-19f5da5f773f tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:33 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-0978847b-619e-460a-86fc-19f5da5f773f tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:46:33 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-0978847b-619e-460a-86fc-19f5da5f773f tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:46:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-0978847b-619e-460a-86fc-19f5da5f773f tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-0978847b-619e-460a-86fc-19f5da5f773f tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:33 devstack sudo[89538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:46:33 devstack sudo[89538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:33 devstack sudo[89535]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b27bd8ba-8358-4912-b1da-1d034699048c tempest-VolumesSnapshotListTestJSON-925414587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.7994f0b2-008d-4241-aebd-1e41855e67cf" returned: 0 in 0.499s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b27bd8ba-8358-4912-b1da-1d034699048c tempest-VolumesSnapshotListTestJSON-925414587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.251s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-6c2aad14-29cc-4c77-a0f1-6d87e2f7cc3f tempest-VolumeDependencyTests-162807668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.072s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:33 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-6c2aad14-29cc-4c77-a0f1-6d87e2f7cc3f tempest-VolumeDependencyTests-162807668 None] Creating offline snapshot 98ec4d17-effd-4607-bd4b-4a6e1ef4f67d of volume 19daf867-ea37-47be-b996-2f63864e2d72 {{(pid=84248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 04:46:33 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-b27bd8ba-8358-4912-b1da-1d034699048c tempest-VolumesSnapshotListTestJSON-925414587 None] Create snapshot completed successfully
Feb 28 04:46:33 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b94c84-7b99-47f2-bb15-7dd301e5d1c7]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6c2aad14-29cc-4c77-a0f1-6d87e2f7cc3f tempest-VolumeDependencyTests-162807668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:33 devstack sudo[89541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72
Feb 28 04:46:33 devstack sudo[89541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:33 devstack sudo[89538]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-0978847b-619e-460a-86fc-19f5da5f773f tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.475s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:33 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-0978847b-619e-460a-86fc-19f5da5f773f tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:46:33 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-0978847b-619e-460a-86fc-19f5da5f773f tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Deleted volume successfully.
Feb 28 04:46:33 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-0978847b-619e-460a-86fc-19f5da5f773f tempest-VolumeRetypeWithoutMigrationTest-1123810770 None] Lock "cinder-2aa53b74-7ed4-4a2e-ade6-d2497cb5dfe9-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:33 devstack sudo[89541]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6c2aad14-29cc-4c77-a0f1-6d87e2f7cc3f tempest-VolumeDependencyTests-162807668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72" returned: 0 in 0.538s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6c2aad14-29cc-4c77-a0f1-6d87e2f7cc3f tempest-VolumeDependencyTests-162807668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72.98ec4d17-effd-4607-bd4b-4a6e1ef4f67d 1G {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:33 devstack sudo[89547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72.98ec4d17-effd-4607-bd4b-4a6e1ef4f67d 1G
Feb 28 04:46:33 devstack sudo[89547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-edcc5712-666b-491b-bcc5-306c7da691df tempest-VolumesSnapshotListTestJSON-925414587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:34 devstack sudo[89547]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6c2aad14-29cc-4c77-a0f1-6d87e2f7cc3f tempest-VolumeDependencyTests-162807668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72.98ec4d17-effd-4607-bd4b-4a6e1ef4f67d 1G" returned: 0 in 0.633s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6c2aad14-29cc-4c77-a0f1-6d87e2f7cc3f tempest-VolumeDependencyTests-162807668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19daf867-ea37-47be-b996-2f63864e2d72 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72.98ec4d17-effd-4607-bd4b-4a6e1ef4f67d {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:34 devstack sudo[89552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19daf867-ea37-47be-b996-2f63864e2d72 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72.98ec4d17-effd-4607-bd4b-4a6e1ef4f67d
Feb 28 04:46:34 devstack sudo[89552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:35 devstack sudo[89552]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6c2aad14-29cc-4c77-a0f1-6d87e2f7cc3f tempest-VolumeDependencyTests-162807668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19daf867-ea37-47be-b996-2f63864e2d72 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72.98ec4d17-effd-4607-bd4b-4a6e1ef4f67d" returned: 0 in 0.539s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:35 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-6c2aad14-29cc-4c77-a0f1-6d87e2f7cc3f tempest-VolumeDependencyTests-162807668 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72.98ec4d17-effd-4607-bd4b-4a6e1ef4f67d is being set with open permissions: ugo+rw
Feb 28 04:46:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6c2aad14-29cc-4c77-a0f1-6d87e2f7cc3f tempest-VolumeDependencyTests-162807668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72.98ec4d17-effd-4607-bd4b-4a6e1ef4f67d {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:35 devstack sudo[89557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72.98ec4d17-effd-4607-bd4b-4a6e1ef4f67d
Feb 28 04:46:35 devstack sudo[89557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:35 devstack sudo[89557]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6c2aad14-29cc-4c77-a0f1-6d87e2f7cc3f tempest-VolumeDependencyTests-162807668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72.98ec4d17-effd-4607-bd4b-4a6e1ef4f67d" returned: 0 in 0.470s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6c2aad14-29cc-4c77-a0f1-6d87e2f7cc3f tempest-VolumeDependencyTests-162807668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:35 devstack sudo[89560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72.info
Feb 28 04:46:35 devstack sudo[89560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:36 devstack sudo[89560]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6c2aad14-29cc-4c77-a0f1-6d87e2f7cc3f tempest-VolumeDependencyTests-162807668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72.info" returned: 0 in 0.507s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:36 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-6c2aad14-29cc-4c77-a0f1-6d87e2f7cc3f tempest-VolumeDependencyTests-162807668 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72.info is being set with open permissions: ugo+rw
Feb 28 04:46:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6c2aad14-29cc-4c77-a0f1-6d87e2f7cc3f tempest-VolumeDependencyTests-162807668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:36 devstack sudo[89563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72.info
Feb 28 04:46:36 devstack sudo[89563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:36 devstack sudo[89563]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6c2aad14-29cc-4c77-a0f1-6d87e2f7cc3f tempest-VolumeDependencyTests-162807668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72.info" returned: 0 in 0.472s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-6c2aad14-29cc-4c77-a0f1-6d87e2f7cc3f tempest-VolumeDependencyTests-162807668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.231s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-edcc5712-666b-491b-bcc5-306c7da691df tempest-VolumesSnapshotListTestJSON-925414587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.427s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:36 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-edcc5712-666b-491b-bcc5-306c7da691df tempest-VolumesSnapshotListTestJSON-925414587 None] Creating offline snapshot 5480c230-3201-4f28-858f-94831b846238 of volume 0483b314-d3d9-47ac-b27d-5dfbeaa8911e {{(pid=84248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 04:46:36 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1852bd-7f52-438d-b7af-0723e208d35b]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-edcc5712-666b-491b-bcc5-306c7da691df tempest-VolumesSnapshotListTestJSON-925414587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.7994f0b2-008d-4241-aebd-1e41855e67cf {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:36 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-6c2aad14-29cc-4c77-a0f1-6d87e2f7cc3f tempest-VolumeDependencyTests-162807668 None] Create snapshot completed successfully
Feb 28 04:46:36 devstack sudo[89566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.7994f0b2-008d-4241-aebd-1e41855e67cf
Feb 28 04:46:36 devstack sudo[89566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:37 devstack sudo[89566]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-edcc5712-666b-491b-bcc5-306c7da691df tempest-VolumesSnapshotListTestJSON-925414587 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.7994f0b2-008d-4241-aebd-1e41855e67cf" returned: 0 in 0.556s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:37 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-edcc5712-666b-491b-bcc5-306c7da691df tempest-VolumesSnapshotListTestJSON-925414587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:46:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-edcc5712-666b-491b-bcc5-306c7da691df tempest-VolumesSnapshotListTestJSON-925414587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.7994f0b2-008d-4241-aebd-1e41855e67cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.5480c230-3201-4f28-858f-94831b846238 1G {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:37 devstack sudo[89571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.7994f0b2-008d-4241-aebd-1e41855e67cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.5480c230-3201-4f28-858f-94831b846238 1G
Feb 28 04:46:37 devstack sudo[89571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:37 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-41247c59-0325-45eb-9b59-5024e82e8bb9 tempest-VolumesSnapshotTestJSON-1450209302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:46:37 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-41247c59-0325-45eb-9b59-5024e82e8bb9 tempest-VolumesSnapshotTestJSON-1450209302 None] Flow 'volume_create_manager' (cf9deb97-54e8-4c07-b68f-30b95b971d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:46:37 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-41247c59-0325-45eb-9b59-5024e82e8bb9 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cc600ea-4ad0-4be9-b584-36cec6e82e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:37 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-41247c59-0325-45eb-9b59-5024e82e8bb9 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cc600ea-4ad0-4be9-b584-36cec6e82e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-226926114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c46cc74-4a65-4ddf-adc2-04c040dc22c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38e49879b3b24d2d9b0adf1476729ddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:46:37Z,use_quota=True,user_id='5ddc0b80823a4acc8f06430d30a63512',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:37 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-41247c59-0325-45eb-9b59-5024e82e8bb9 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b54e2fd9-840c-4991-9535-27d20a1eb1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:37 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-41247c59-0325-45eb-9b59-5024e82e8bb9 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b54e2fd9-840c-4991-9535-27d20a1eb1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:37 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-41247c59-0325-45eb-9b59-5024e82e8bb9 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5648a007-ef8a-4e21-a5bf-414d733fcbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:37 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-41247c59-0325-45eb-9b59-5024e82e8bb9 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5648a007-ef8a-4e21-a5bf-414d733fcbcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c46cc74-4a65-4ddf-adc2-04c040dc22c2', 'volume_name': 'volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:37 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-41247c59-0325-45eb-9b59-5024e82e8bb9 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b38642fc-11e2-440f-a8f6-e85ff1a80b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:37 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-41247c59-0325-45eb-9b59-5024e82e8bb9 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b38642fc-11e2-440f-a8f6-e85ff1a80b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:37 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-41247c59-0325-45eb-9b59-5024e82e8bb9 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be3bca57-07d5-404f-bdc9-7a7dede1eb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:37 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-41247c59-0325-45eb-9b59-5024e82e8bb9 tempest-VolumesSnapshotTestJSON-1450209302 None] Volume 8c46cc74-4a65-4ddf-adc2-04c040dc22c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2', 'volume_size': 1}
Feb 28 04:46:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-41247c59-0325-45eb-9b59-5024e82e8bb9 tempest-VolumesSnapshotTestJSON-1450209302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:37 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-50d308b1-4b02-457e-8325-3abbb06a6e73 tempest-VolumesTransfersTest-2081745280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:46:37 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-50d308b1-4b02-457e-8325-3abbb06a6e73 tempest-VolumesTransfersTest-2081745280 None] Flow 'volume_create_manager' (ff978b72-5a65-433e-a4ad-66a020610036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:46:37 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-50d308b1-4b02-457e-8325-3abbb06a6e73 tempest-VolumesTransfersTest-2081745280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c587b387-c1d2-4ace-95f5-face2a2d887b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:37 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-50d308b1-4b02-457e-8325-3abbb06a6e73 tempest-VolumesTransfersTest-2081745280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c587b387-c1d2-4ace-95f5-face2a2d887b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-118343558',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a838a66-ce79-4356-8adc-40732cb06eeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef5f45fe60ea4c06a2a1e6f63864a383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:46:38Z,use_quota=True,user_id='390498d702294e7f880c15e10b4968cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:37 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-50d308b1-4b02-457e-8325-3abbb06a6e73 tempest-VolumesTransfersTest-2081745280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b597eb04-964e-4b6b-bfed-aa22c5b1162b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:37 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-50d308b1-4b02-457e-8325-3abbb06a6e73 tempest-VolumesTransfersTest-2081745280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b597eb04-964e-4b6b-bfed-aa22c5b1162b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:37 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-50d308b1-4b02-457e-8325-3abbb06a6e73 tempest-VolumesTransfersTest-2081745280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6965607c-1473-4032-bf11-23b73e65168e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:37 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-50d308b1-4b02-457e-8325-3abbb06a6e73 tempest-VolumesTransfersTest-2081745280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6965607c-1473-4032-bf11-23b73e65168e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a838a66-ce79-4356-8adc-40732cb06eeb', 'volume_name': 'volume-8a838a66-ce79-4356-8adc-40732cb06eeb', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:37 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-50d308b1-4b02-457e-8325-3abbb06a6e73 tempest-VolumesTransfersTest-2081745280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bcaf507-7c6a-49a0-81fd-c381bc3e1f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:37 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-50d308b1-4b02-457e-8325-3abbb06a6e73 tempest-VolumesTransfersTest-2081745280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bcaf507-7c6a-49a0-81fd-c381bc3e1f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:37 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-50d308b1-4b02-457e-8325-3abbb06a6e73 tempest-VolumesTransfersTest-2081745280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (042ca55d-1c9a-4373-9c3a-10535d1e115c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:37 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-50d308b1-4b02-457e-8325-3abbb06a6e73 tempest-VolumesTransfersTest-2081745280 None] Volume 8a838a66-ce79-4356-8adc-40732cb06eeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a838a66-ce79-4356-8adc-40732cb06eeb', 'volume_size': 1}
Feb 28 04:46:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-50d308b1-4b02-457e-8325-3abbb06a6e73 tempest-VolumesTransfersTest-2081745280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:37 devstack sudo[89571]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-edcc5712-666b-491b-bcc5-306c7da691df tempest-VolumesSnapshotListTestJSON-925414587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.7994f0b2-008d-4241-aebd-1e41855e67cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.5480c230-3201-4f28-858f-94831b846238 1G" returned: 0 in 0.573s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-edcc5712-666b-491b-bcc5-306c7da691df tempest-VolumesSnapshotListTestJSON-925414587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.7994f0b2-008d-4241-aebd-1e41855e67cf -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.5480c230-3201-4f28-858f-94831b846238 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:37 devstack sudo[89576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.7994f0b2-008d-4241-aebd-1e41855e67cf -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.5480c230-3201-4f28-858f-94831b846238
Feb 28 04:46:37 devstack sudo[89576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:37 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:46:37 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Flow 'volume_create_manager' (2c348297-f1ee-4d36-b7dc-a72513e23ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:46:37 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6f46e62-b682-442a-bba4-1efecb2b853b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:37 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6f46e62-b682-442a-bba4-1efecb2b853b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1856544949',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08e995cf-e5b7-4d72-b117-dae91ad23ecf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f43d0cbb6ae04f61a534ccddb799a55a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=98ec4d17-effd-4607-bd4b-4a6e1ef4f67d,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:46:38Z,use_quota=True,user_id='08fd9f1d4efd4e3e98df0bea509eb225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:37 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dfcaa5d-80fb-4520-8e4e-f8bb809f63ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:37 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dfcaa5d-80fb-4520-8e4e-f8bb809f63ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:37 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98668c12-a851-4606-ae7e-3ea4fa5de73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:37 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98668c12-a851-4606-ae7e-3ea4fa5de73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '08e995cf-e5b7-4d72-b117-dae91ad23ecf', 'volume_name': 'volume-08e995cf-e5b7-4d72-b117-dae91ad23ecf', 'volume_size': 1, 'snapshot_id': '98ec4d17-effd-4607-bd4b-4a6e1ef4f67d'}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:37 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef47e444-47af-449a-85d8-a9131638835c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:37 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef47e444-47af-449a-85d8-a9131638835c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:37 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8b9f76c-2327-44d1-a605-d51543d98756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:37 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Volume 08e995cf-e5b7-4d72-b117-dae91ad23ecf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-08e995cf-e5b7-4d72-b117-dae91ad23ecf', 'volume_size': 1, 'snapshot_id': '98ec4d17-effd-4607-bd4b-4a6e1ef4f67d'}
Feb 28 04:46:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:38 devstack sudo[89576]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-edcc5712-666b-491b-bcc5-306c7da691df tempest-VolumesSnapshotListTestJSON-925414587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.7994f0b2-008d-4241-aebd-1e41855e67cf -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.5480c230-3201-4f28-858f-94831b846238" returned: 0 in 0.422s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:38 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-edcc5712-666b-491b-bcc5-306c7da691df tempest-VolumesSnapshotListTestJSON-925414587 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.5480c230-3201-4f28-858f-94831b846238 is being set with open permissions: ugo+rw
Feb 28 04:46:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-edcc5712-666b-491b-bcc5-306c7da691df tempest-VolumesSnapshotListTestJSON-925414587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.5480c230-3201-4f28-858f-94831b846238 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:38 devstack sudo[89581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.5480c230-3201-4f28-858f-94831b846238
Feb 28 04:46:38 devstack sudo[89581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:38 devstack sudo[89581]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-edcc5712-666b-491b-bcc5-306c7da691df tempest-VolumesSnapshotListTestJSON-925414587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.5480c230-3201-4f28-858f-94831b846238" returned: 0 in 0.393s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-edcc5712-666b-491b-bcc5-306c7da691df tempest-VolumesSnapshotListTestJSON-925414587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-41247c59-0325-45eb-9b59-5024e82e8bb9 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.957s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:38 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-41247c59-0325-45eb-9b59-5024e82e8bb9 tempest-VolumesSnapshotTestJSON-1450209302 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-226926114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c46cc74-4a65-4ddf-adc2-04c040dc22c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38e49879b3b24d2d9b0adf1476729ddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:46:37Z,use_quota=True,user_id='5ddc0b80823a4acc8f06430d30a63512',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:46:38 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-41247c59-0325-45eb-9b59-5024e82e8bb9 tempest-VolumesSnapshotTestJSON-1450209302 None] Creating volume 8c46cc74-4a65-4ddf-adc2-04c040dc22c2 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:46:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-41247c59-0325-45eb-9b59-5024e82e8bb9 tempest-VolumesSnapshotTestJSON-1450209302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-41247c59-0325-45eb-9b59-5024e82e8bb9 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:38 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-41247c59-0325-45eb-9b59-5024e82e8bb9 tempest-VolumesSnapshotTestJSON-1450209302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:46:38 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-41247c59-0325-45eb-9b59-5024e82e8bb9 tempest-VolumesSnapshotTestJSON-1450209302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:46:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-41247c59-0325-45eb-9b59-5024e82e8bb9 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:38 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-41247c59-0325-45eb-9b59-5024e82e8bb9 tempest-VolumesSnapshotTestJSON-1450209302 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:46:38 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-41247c59-0325-45eb-9b59-5024e82e8bb9 tempest-VolumesSnapshotTestJSON-1450209302 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:46:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-41247c59-0325-45eb-9b59-5024e82e8bb9 tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:38 devstack sudo[89584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2 1073741824
Feb 28 04:46:38 devstack sudo[89584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:38 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-edcc5712-666b-491b-bcc5-306c7da691df tempest-VolumesSnapshotListTestJSON-925414587 None] Create snapshot completed successfully
Feb 28 04:46:38 devstack sudo[89584]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-41247c59-0325-45eb-9b59-5024e82e8bb9 tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2 1073741824" returned: 0 in 0.463s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-41247c59-0325-45eb-9b59-5024e82e8bb9 tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:39 devstack sudo[89589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2
Feb 28 04:46:39 devstack sudo[89589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:39 devstack sudo[89589]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-41247c59-0325-45eb-9b59-5024e82e8bb9 tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2" returned: 0 in 0.434s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:39 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-41247c59-0325-45eb-9b59-5024e82e8bb9 tempest-VolumesSnapshotTestJSON-1450209302 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:46:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-41247c59-0325-45eb-9b59-5024e82e8bb9 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-50d308b1-4b02-457e-8325-3abbb06a6e73 tempest-VolumesTransfersTest-2081745280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.804s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:39 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-50d308b1-4b02-457e-8325-3abbb06a6e73 tempest-VolumesTransfersTest-2081745280 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-118343558',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a838a66-ce79-4356-8adc-40732cb06eeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef5f45fe60ea4c06a2a1e6f63864a383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:46:38Z,use_quota=True,user_id='390498d702294e7f880c15e10b4968cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:46:39 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-50d308b1-4b02-457e-8325-3abbb06a6e73 tempest-VolumesTransfersTest-2081745280 None] Creating volume 8a838a66-ce79-4356-8adc-40732cb06eeb {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:46:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-50d308b1-4b02-457e-8325-3abbb06a6e73 tempest-VolumesTransfersTest-2081745280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-50d308b1-4b02-457e-8325-3abbb06a6e73 tempest-VolumesTransfersTest-2081745280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:39 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-50d308b1-4b02-457e-8325-3abbb06a6e73 tempest-VolumesTransfersTest-2081745280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:46:39 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-50d308b1-4b02-457e-8325-3abbb06a6e73 tempest-VolumesTransfersTest-2081745280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:46:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-50d308b1-4b02-457e-8325-3abbb06a6e73 tempest-VolumesTransfersTest-2081745280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:39 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-50d308b1-4b02-457e-8325-3abbb06a6e73 tempest-VolumesTransfersTest-2081745280 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:46:39 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-50d308b1-4b02-457e-8325-3abbb06a6e73 tempest-VolumesTransfersTest-2081745280 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:46:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-50d308b1-4b02-457e-8325-3abbb06a6e73 tempest-VolumesTransfersTest-2081745280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8a838a66-ce79-4356-8adc-40732cb06eeb 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:39 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-41247c59-0325-45eb-9b59-5024e82e8bb9 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be3bca57-07d5-404f-bdc9-7a7dede1eb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:39 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-41247c59-0325-45eb-9b59-5024e82e8bb9 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (464619dc-014a-4d89-81a4-c9ed80f2be50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:39 devstack sudo[89594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8a838a66-ce79-4356-8adc-40732cb06eeb 1073741824
Feb 28 04:46:39 devstack sudo[89594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:39 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-41247c59-0325-45eb-9b59-5024e82e8bb9 tempest-VolumesSnapshotTestJSON-1450209302 None] Volume volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2 (8c46cc74-4a65-4ddf-adc2-04c040dc22c2): created successfully
Feb 28 04:46:39 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-41247c59-0325-45eb-9b59-5024e82e8bb9 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (464619dc-014a-4d89-81a4-c9ed80f2be50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:39 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-41247c59-0325-45eb-9b59-5024e82e8bb9 tempest-VolumesSnapshotTestJSON-1450209302 None] Flow 'volume_create_manager' (cf9deb97-54e8-4c07-b68f-30b95b971d1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:46:39 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-41247c59-0325-45eb-9b59-5024e82e8bb9 tempest-VolumesSnapshotTestJSON-1450209302 None] Created volume successfully.
Feb 28 04:46:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-7ce21c1e-81d3-4282-875e-2698a09d3e4a tempest-VolumesSnapshotTestJSON-1450209302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:39 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-db1489b3-b658-44b4-95b8-5a33e4799522 tempest-VolumesSnapshotListTestJSON-925414587 None] Acquiring lock "cinder-5480c230-3201-4f28-858f-94831b846238-delete_snapshot" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:39 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-db1489b3-b658-44b4-95b8-5a33e4799522 tempest-VolumesSnapshotListTestJSON-925414587 None] Lock "cinder-5480c230-3201-4f28-858f-94831b846238-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:39 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-db1489b3-b658-44b4-95b8-5a33e4799522 tempest-VolumesSnapshotListTestJSON-925414587 None] Acquiring lock "cinder-quobyte-0483b314-d3d9-47ac-b27d-5dfbeaa8911e" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:39 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-db1489b3-b658-44b4-95b8-5a33e4799522 tempest-VolumesSnapshotListTestJSON-925414587 None] Lock "cinder-quobyte-0483b314-d3d9-47ac-b27d-5dfbeaa8911e" acquired by "delete_snapshot" :: waited 0.012s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:39 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-db1489b3-b658-44b4-95b8-5a33e4799522 tempest-VolumesSnapshotListTestJSON-925414587 None] Acquiring lock "cinder-quobyte-5480c230-3201-4f28-858f-94831b846238" by "_delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:39 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-db1489b3-b658-44b4-95b8-5a33e4799522 tempest-VolumesSnapshotListTestJSON-925414587 None] Lock "cinder-quobyte-5480c230-3201-4f28-858f-94831b846238" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:39 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-db1489b3-b658-44b4-95b8-5a33e4799522 tempest-VolumesSnapshotListTestJSON-925414587 None] Deleting offline snapshot 5480c230-3201-4f28-858f-94831b846238 of volume 0483b314-d3d9-47ac-b27d-5dfbeaa8911e {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 04:46:39 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-db1489b3-b658-44b4-95b8-5a33e4799522 tempest-VolumesSnapshotListTestJSON-925414587 None] snapshot_file for this snap is: volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.5480c230-3201-4f28-858f-94831b846238 {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 04:46:39 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[a135684d-8bb1-4465-913b-ad6d320a1370]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-db1489b3-b658-44b4-95b8-5a33e4799522 tempest-VolumesSnapshotListTestJSON-925414587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.5480c230-3201-4f28-858f-94831b846238 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:39 devstack sudo[89594]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-50d308b1-4b02-457e-8325-3abbb06a6e73 tempest-VolumesTransfersTest-2081745280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8a838a66-ce79-4356-8adc-40732cb06eeb 1073741824" returned: 0 in 0.547s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:40 devstack sudo[89600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.5480c230-3201-4f28-858f-94831b846238
Feb 28 04:46:40 devstack sudo[89600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-50d308b1-4b02-457e-8325-3abbb06a6e73 tempest-VolumesTransfersTest-2081745280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8a838a66-ce79-4356-8adc-40732cb06eeb {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:40 devstack sudo[89602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8a838a66-ce79-4356-8adc-40732cb06eeb
Feb 28 04:46:40 devstack sudo[89602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:40 devstack sudo[89600]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-db1489b3-b658-44b4-95b8-5a33e4799522 tempest-VolumesSnapshotListTestJSON-925414587 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.5480c230-3201-4f28-858f-94831b846238" returned: 0 in 0.461s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:40 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-db1489b3-b658-44b4-95b8-5a33e4799522 tempest-VolumesSnapshotListTestJSON-925414587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:46:40 devstack sudo[89602]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-50d308b1-4b02-457e-8325-3abbb06a6e73 tempest-VolumesTransfersTest-2081745280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8a838a66-ce79-4356-8adc-40732cb06eeb" returned: 0 in 0.389s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:40 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-50d308b1-4b02-457e-8325-3abbb06a6e73 tempest-VolumesTransfersTest-2081745280 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:46:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-50d308b1-4b02-457e-8325-3abbb06a6e73 tempest-VolumesTransfersTest-2081745280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:40 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbeb394-2479-4c3c-b7d9-4667b9276b21]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.575s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:40 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Acquiring lock "cinder-quobyte-98ec4d17-effd-4607-bd4b-4a6e1ef4f67d-08e995cf-e5b7-4d72-b117-dae91ad23ecf" by "_create_volume_from_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:40 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-50d308b1-4b02-457e-8325-3abbb06a6e73 tempest-VolumesTransfersTest-2081745280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (042ca55d-1c9a-4373-9c3a-10535d1e115c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a838a66-ce79-4356-8adc-40732cb06eeb', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:40 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-50d308b1-4b02-457e-8325-3abbb06a6e73 tempest-VolumesTransfersTest-2081745280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7469626d-a2a6-41b8-b083-93a6bf6158e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-db1489b3-b658-44b4-95b8-5a33e4799522 tempest-VolumesSnapshotListTestJSON-925414587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.7994f0b2-008d-4241-aebd-1e41855e67cf {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:40 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-50d308b1-4b02-457e-8325-3abbb06a6e73 tempest-VolumesTransfersTest-2081745280 None] Volume volume-8a838a66-ce79-4356-8adc-40732cb06eeb (8a838a66-ce79-4356-8adc-40732cb06eeb): created successfully
Feb 28 04:46:40 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-50d308b1-4b02-457e-8325-3abbb06a6e73 tempest-VolumesTransfersTest-2081745280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7469626d-a2a6-41b8-b083-93a6bf6158e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:40 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-50d308b1-4b02-457e-8325-3abbb06a6e73 tempest-VolumesTransfersTest-2081745280 None] Flow 'volume_create_manager' (ff978b72-5a65-433e-a4ad-66a020610036) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:46:40 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-50d308b1-4b02-457e-8325-3abbb06a6e73 tempest-VolumesTransfersTest-2081745280 None] Created volume successfully.
Feb 28 04:46:40 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Lock "cinder-quobyte-98ec4d17-effd-4607-bd4b-4a6e1ef4f67d-08e995cf-e5b7-4d72-b117-dae91ad23ecf" acquired by "_create_volume_from_snapshot" :: waited 0.060s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:40 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Creating volume 08e995cf-e5b7-4d72-b117-dae91ad23ecf from snapshot 98ec4d17-effd-4607-bd4b-4a6e1ef4f67d {{(pid=84248) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Feb 28 04:46:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:40 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:46:40 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:46:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:40 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:46:40 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Acquiring lock "cinder-quobyte-08e995cf-e5b7-4d72-b117-dae91ad23ecf" by "_copy_volume_from_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:40 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Lock "cinder-quobyte-08e995cf-e5b7-4d72-b117-dae91ad23ecf" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:40 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] snapshot: 98ec4d17-effd-4607-bd4b-4a6e1ef4f67d, volume: 08e995cf-e5b7-4d72-b117-dae91ad23ecf,  {{(pid=84248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 28 04:46:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:40 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:46:40 devstack sudo[89608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.7994f0b2-008d-4241-aebd-1e41855e67cf
Feb 28 04:46:40 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:46:40 devstack sudo[89608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:40 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f63d7b-09f7-4739-8ad9-740adbb3adfa]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72.98ec4d17-effd-4607-bd4b-4a6e1ef4f67d {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:40 devstack sudo[89610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72.98ec4d17-effd-4607-bd4b-4a6e1ef4f67d
Feb 28 04:46:40 devstack sudo[89610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:40 devstack sudo[89608]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-db1489b3-b658-44b4-95b8-5a33e4799522 tempest-VolumesSnapshotListTestJSON-925414587 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.7994f0b2-008d-4241-aebd-1e41855e67cf" returned: 0 in 0.514s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:40 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-db1489b3-b658-44b4-95b8-5a33e4799522 tempest-VolumesSnapshotListTestJSON-925414587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:46:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-db1489b3-b658-44b4-95b8-5a33e4799522 tempest-VolumesSnapshotListTestJSON-925414587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.5480c230-3201-4f28-858f-94831b846238 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:40 devstack sudo[89616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.5480c230-3201-4f28-858f-94831b846238
Feb 28 04:46:40 devstack sudo[89616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:41 devstack sudo[89610]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72.98ec4d17-effd-4607-bd4b-4a6e1ef4f67d" returned: 0 in 0.522s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:41 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19daf867-ea37-47be-b996-2f63864e2d72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:46:41 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] will copy from snapshot at /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72 {{(pid=84248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 28 04:46:41 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Creating direct copy from snapshot {{(pid=84248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 28 04:46:41 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[780f1750-cb57-4107-b14d-6a52ff51da2c]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:41 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-b8b32781-43fd-421a-9f49-81fc15d0ed26 tempest-VolumesTransfersTest-1032887936 None] Transfer volume completed successfully.
Feb 28 04:46:41 devstack sudo[89620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72
Feb 28 04:46:41 devstack sudo[89620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:41 devstack sudo[89616]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-db1489b3-b658-44b4-95b8-5a33e4799522 tempest-VolumesSnapshotListTestJSON-925414587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.5480c230-3201-4f28-858f-94831b846238" returned: 0 in 0.477s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-db1489b3-b658-44b4-95b8-5a33e4799522 tempest-VolumesSnapshotListTestJSON-925414587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.5480c230-3201-4f28-858f-94831b846238 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:41 devstack sudo[89625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.5480c230-3201-4f28-858f-94831b846238
Feb 28 04:46:41 devstack sudo[89625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:41 devstack sudo[89620]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72" returned: 0 in 0.493s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:41 devstack cinder-volume[84248]: DEBUG cinder.utils [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Path /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-08e995cf-e5b7-4d72-b117-dae91ad23ecf not found in is_blk_device check {{(pid=84248) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 28 04:46:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-08e995cf-e5b7-4d72-b117-dae91ad23ecf {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:41 devstack sudo[89630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-08e995cf-e5b7-4d72-b117-dae91ad23ecf
Feb 28 04:46:41 devstack sudo[89630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:41 devstack sudo[89625]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-db1489b3-b658-44b4-95b8-5a33e4799522 tempest-VolumesSnapshotListTestJSON-925414587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.5480c230-3201-4f28-858f-94831b846238" returned: 0 in 0.444s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:41 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-b6bb8304-d548-4a68-af15-8c43f1bec422 tempest-VolumesTransfersTest-505765435 None] Acquiring lock "cinder-8a838a66-ce79-4356-8adc-40732cb06eeb-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:41 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-db1489b3-b658-44b4-95b8-5a33e4799522 tempest-VolumesSnapshotListTestJSON-925414587 None] Lock "cinder-quobyte-5480c230-3201-4f28-858f-94831b846238" released by "_delete_snapshot" :: held 1.974s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:41 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-b6bb8304-d548-4a68-af15-8c43f1bec422 tempest-VolumesTransfersTest-505765435 None] Lock "cinder-8a838a66-ce79-4356-8adc-40732cb06eeb-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:41 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-db1489b3-b658-44b4-95b8-5a33e4799522 tempest-VolumesSnapshotListTestJSON-925414587 None] Lock "cinder-quobyte-0483b314-d3d9-47ac-b27d-5dfbeaa8911e" released by "delete_snapshot" :: held 1.993s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:41 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-b6bb8304-d548-4a68-af15-8c43f1bec422 tempest-VolumesTransfersTest-505765435 None] Acquiring lock "cinder-quobyte-8a838a66-ce79-4356-8adc-40732cb06eeb" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:41 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-b6bb8304-d548-4a68-af15-8c43f1bec422 tempest-VolumesTransfersTest-505765435 None] Lock "cinder-quobyte-8a838a66-ce79-4356-8adc-40732cb06eeb" acquired by "delete_volume" :: waited 0.011s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:41 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[13431941-0b4a-4da1-851f-035effd52ca5]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b6bb8304-d548-4a68-af15-8c43f1bec422 tempest-VolumesTransfersTest-505765435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8a838a66-ce79-4356-8adc-40732cb06eeb {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:42 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-db1489b3-b658-44b4-95b8-5a33e4799522 tempest-VolumesSnapshotListTestJSON-925414587 None] Created reservations ['8ed8e04b-dc3d-4c7b-b836-d187803a02fb', '9363a653-e829-46fc-a91d-02939a00ffba', 'ff6f70cd-2523-436c-ac07-099bcc7143e2', '905c5dda-7fe1-4246-b4ec-337fe6c85ff5'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:46:42 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-db1489b3-b658-44b4-95b8-5a33e4799522 tempest-VolumesSnapshotListTestJSON-925414587 None] Delete snapshot completed successfully.
Feb 28 04:46:42 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-db1489b3-b658-44b4-95b8-5a33e4799522 tempest-VolumesSnapshotListTestJSON-925414587 None] Lock "cinder-5480c230-3201-4f28-858f-94831b846238-delete_snapshot" released by "delete_snapshot" :: held 2.154s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:42 devstack sudo[89636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8a838a66-ce79-4356-8adc-40732cb06eeb
Feb 28 04:46:42 devstack sudo[89636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:43 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f263cddf-3a82-4f14-8af3-bb3a5caffe14 tempest-VolumesSnapshotListTestJSON-925414587 None] Acquiring lock "cinder-7994f0b2-008d-4241-aebd-1e41855e67cf-delete_snapshot" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:43 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f263cddf-3a82-4f14-8af3-bb3a5caffe14 tempest-VolumesSnapshotListTestJSON-925414587 None] Lock "cinder-7994f0b2-008d-4241-aebd-1e41855e67cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:43 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f263cddf-3a82-4f14-8af3-bb3a5caffe14 tempest-VolumesSnapshotListTestJSON-925414587 None] Acquiring lock "cinder-quobyte-0483b314-d3d9-47ac-b27d-5dfbeaa8911e" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:43 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f263cddf-3a82-4f14-8af3-bb3a5caffe14 tempest-VolumesSnapshotListTestJSON-925414587 None] Lock "cinder-quobyte-0483b314-d3d9-47ac-b27d-5dfbeaa8911e" acquired by "delete_snapshot" :: waited 0.028s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:43 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f263cddf-3a82-4f14-8af3-bb3a5caffe14 tempest-VolumesSnapshotListTestJSON-925414587 None] Acquiring lock "cinder-quobyte-7994f0b2-008d-4241-aebd-1e41855e67cf" by "_delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:43 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f263cddf-3a82-4f14-8af3-bb3a5caffe14 tempest-VolumesSnapshotListTestJSON-925414587 None] Lock "cinder-quobyte-7994f0b2-008d-4241-aebd-1e41855e67cf" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:43 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-f263cddf-3a82-4f14-8af3-bb3a5caffe14 tempest-VolumesSnapshotListTestJSON-925414587 None] Deleting offline snapshot 7994f0b2-008d-4241-aebd-1e41855e67cf of volume 0483b314-d3d9-47ac-b27d-5dfbeaa8911e {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 04:46:43 devstack sudo[89636]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:43 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-f263cddf-3a82-4f14-8af3-bb3a5caffe14 tempest-VolumesSnapshotListTestJSON-925414587 None] snapshot_file for this snap is: volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.7994f0b2-008d-4241-aebd-1e41855e67cf {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 04:46:43 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b6bb8304-d548-4a68-af15-8c43f1bec422 tempest-VolumesTransfersTest-505765435 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8a838a66-ce79-4356-8adc-40732cb06eeb" returned: 0 in 1.337s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:43 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b6bb8304-d548-4a68-af15-8c43f1bec422 tempest-VolumesTransfersTest-505765435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8a838a66-ce79-4356-8adc-40732cb06eeb {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:43 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[066dcdd4-8911-4b4d-9f6c-403b0acca4d2]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:43 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f263cddf-3a82-4f14-8af3-bb3a5caffe14 tempest-VolumesSnapshotListTestJSON-925414587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.7994f0b2-008d-4241-aebd-1e41855e67cf {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:43 devstack sudo[89650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8a838a66-ce79-4356-8adc-40732cb06eeb
Feb 28 04:46:43 devstack sudo[89650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:43 devstack sudo[89651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.7994f0b2-008d-4241-aebd-1e41855e67cf
Feb 28 04:46:43 devstack sudo[89651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:43 devstack sudo[89630]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:43 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-08e995cf-e5b7-4d72-b117-dae91ad23ecf" returned: 0 in 2.176s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:43 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d0fb8d-5202-4091-81d9-c5536093ad62]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:43 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:43 devstack sudo[89654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72
Feb 28 04:46:43 devstack sudo[89654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:43 devstack sudo[89650]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:43 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b6bb8304-d548-4a68-af15-8c43f1bec422 tempest-VolumesTransfersTest-505765435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8a838a66-ce79-4356-8adc-40732cb06eeb" returned: 0 in 0.612s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:43 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-b6bb8304-d548-4a68-af15-8c43f1bec422 tempest-VolumesTransfersTest-505765435 None] Lock "cinder-quobyte-8a838a66-ce79-4356-8adc-40732cb06eeb" released by "delete_volume" :: held 1.973s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:43 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-b6bb8304-d548-4a68-af15-8c43f1bec422 tempest-VolumesTransfersTest-505765435 None] Created reservations ['ea3b0320-6c81-4b8f-8a72-96dd50bbecdd', 'ae8b52f1-2079-4e26-a152-53d66062561c', '54efd852-7604-49e1-91ec-d53f8da7a0fa', '75deb3ba-c722-40c4-8b85-ff34c01597ca'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:46:43 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b6bb8304-d548-4a68-af15-8c43f1bec422 tempest-VolumesTransfersTest-505765435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:43 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b6bb8304-d548-4a68-af15-8c43f1bec422 tempest-VolumesTransfersTest-505765435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:43 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-b6bb8304-d548-4a68-af15-8c43f1bec422 tempest-VolumesTransfersTest-505765435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:46:44 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-b6bb8304-d548-4a68-af15-8c43f1bec422 tempest-VolumesTransfersTest-505765435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:46:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b6bb8304-d548-4a68-af15-8c43f1bec422 tempest-VolumesTransfersTest-505765435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b6bb8304-d548-4a68-af15-8c43f1bec422 tempest-VolumesTransfersTest-505765435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:44 devstack sudo[89651]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f263cddf-3a82-4f14-8af3-bb3a5caffe14 tempest-VolumesSnapshotListTestJSON-925414587 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.7994f0b2-008d-4241-aebd-1e41855e67cf" returned: 0 in 0.685s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:44 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-f263cddf-3a82-4f14-8af3-bb3a5caffe14 tempest-VolumesSnapshotListTestJSON-925414587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:46:44 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bf8bd0-53fe-4856-9237-54d02fcc58cf]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f263cddf-3a82-4f14-8af3-bb3a5caffe14 tempest-VolumesSnapshotListTestJSON-925414587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.2ca963f8-57f3-4857-9299-9c01b37bfbe2 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:44 devstack sudo[89660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:46:44 devstack sudo[89660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:44 devstack sudo[89662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.2ca963f8-57f3-4857-9299-9c01b37bfbe2
Feb 28 04:46:44 devstack sudo[89662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:44 devstack sudo[89654]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72" returned: 0 in 0.673s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:44 devstack cinder-volume[84248]: DEBUG cinder.image.image_utils [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Image conversion details: src /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72, size 1024.00 MB, duration 2.18 sec, destination /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-08e995cf-e5b7-4d72-b117-dae91ad23ecf {{(pid=84248) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 28 04:46:44 devstack cinder-volume[84248]: INFO cinder.image.image_utils [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Converted 1024.00 MB image at 470.42 MB/s
Feb 28 04:46:44 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-08e995cf-e5b7-4d72-b117-dae91ad23ecf is being set with open permissions: ugo+rw
Feb 28 04:46:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-08e995cf-e5b7-4d72-b117-dae91ad23ecf {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:44 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-064138f3-193a-43d7-a398-e96b144386c8 tempest-VolumesTransfersTest-2081745280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:46:44 devstack sudo[89668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-08e995cf-e5b7-4d72-b117-dae91ad23ecf
Feb 28 04:46:44 devstack sudo[89668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:44 devstack sudo[89660]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:44 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-064138f3-193a-43d7-a398-e96b144386c8 tempest-VolumesTransfersTest-2081745280 None] Flow 'volume_create_manager' (de6af4ad-c9ef-4348-92b6-14588752a07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:46:44 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-064138f3-193a-43d7-a398-e96b144386c8 tempest-VolumesTransfersTest-2081745280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d05cfcbd-2c5f-4794-94cb-6f3e4734630c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b6bb8304-d548-4a68-af15-8c43f1bec422 tempest-VolumesTransfersTest-505765435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.462s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:44 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-b6bb8304-d548-4a68-af15-8c43f1bec422 tempest-VolumesTransfersTest-505765435 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:46:44 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-064138f3-193a-43d7-a398-e96b144386c8 tempest-VolumesTransfersTest-2081745280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d05cfcbd-2c5f-4794-94cb-6f3e4734630c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1491323562',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dfac74d-1d1c-4054-8c3d-8d7825466387,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef5f45fe60ea4c06a2a1e6f63864a383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:46:44Z,use_quota=True,user_id='390498d702294e7f880c15e10b4968cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:44 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-064138f3-193a-43d7-a398-e96b144386c8 tempest-VolumesTransfersTest-2081745280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af107ff-579e-4513-b509-147cb9529e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:44 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-064138f3-193a-43d7-a398-e96b144386c8 tempest-VolumesTransfersTest-2081745280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af107ff-579e-4513-b509-147cb9529e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:44 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-064138f3-193a-43d7-a398-e96b144386c8 tempest-VolumesTransfersTest-2081745280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (329951f8-08d2-4442-b619-225fdb9b8c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:44 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-064138f3-193a-43d7-a398-e96b144386c8 tempest-VolumesTransfersTest-2081745280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (329951f8-08d2-4442-b619-225fdb9b8c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dfac74d-1d1c-4054-8c3d-8d7825466387', 'volume_name': 'volume-1dfac74d-1d1c-4054-8c3d-8d7825466387', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:44 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-064138f3-193a-43d7-a398-e96b144386c8 tempest-VolumesTransfersTest-2081745280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d83f94af-5bcd-4433-827b-465d8d3efe2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:44 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-064138f3-193a-43d7-a398-e96b144386c8 tempest-VolumesTransfersTest-2081745280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d83f94af-5bcd-4433-827b-465d8d3efe2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:44 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-064138f3-193a-43d7-a398-e96b144386c8 tempest-VolumesTransfersTest-2081745280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1948b40d-1ee9-44b4-abfb-01e16f96aa76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:44 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-064138f3-193a-43d7-a398-e96b144386c8 tempest-VolumesTransfersTest-2081745280 None] Volume 1dfac74d-1d1c-4054-8c3d-8d7825466387: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dfac74d-1d1c-4054-8c3d-8d7825466387', 'volume_size': 1}
Feb 28 04:46:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-064138f3-193a-43d7-a398-e96b144386c8 tempest-VolumesTransfersTest-2081745280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:44 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-b6bb8304-d548-4a68-af15-8c43f1bec422 tempest-VolumesTransfersTest-505765435 None] Deleted volume successfully.
Feb 28 04:46:44 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-b6bb8304-d548-4a68-af15-8c43f1bec422 tempest-VolumesTransfersTest-505765435 None] Lock "cinder-8a838a66-ce79-4356-8adc-40732cb06eeb-delete_volume" released by "delete_volume" :: held 2.608s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:44 devstack sudo[89662]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f263cddf-3a82-4f14-8af3-bb3a5caffe14 tempest-VolumesSnapshotListTestJSON-925414587 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.2ca963f8-57f3-4857-9299-9c01b37bfbe2" returned: 0 in 0.564s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:44 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-f263cddf-3a82-4f14-8af3-bb3a5caffe14 tempest-VolumesSnapshotListTestJSON-925414587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:46:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f263cddf-3a82-4f14-8af3-bb3a5caffe14 tempest-VolumesSnapshotListTestJSON-925414587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.7994f0b2-008d-4241-aebd-1e41855e67cf {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:44 devstack sudo[89673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.7994f0b2-008d-4241-aebd-1e41855e67cf
Feb 28 04:46:44 devstack sudo[89673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:44 devstack sudo[89668]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-08e995cf-e5b7-4d72-b117-dae91ad23ecf" returned: 0 in 0.402s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:44 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Lock "cinder-quobyte-08e995cf-e5b7-4d72-b117-dae91ad23ecf" released by "_copy_volume_from_snapshot" :: held 4.321s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:44 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Lock "cinder-quobyte-98ec4d17-effd-4607-bd4b-4a6e1ef4f67d-08e995cf-e5b7-4d72-b117-dae91ad23ecf" released by "_create_volume_from_snapshot" :: held 4.341s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.403s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-7ce21c1e-81d3-4282-875e-2698a09d3e4a tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.023s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:44 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8b9f76c-2327-44d1-a605-d51543d98756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08e995cf-e5b7-4d72-b117-dae91ad23ecf', 'volume_size': 1, 'snapshot_id': '98ec4d17-effd-4607-bd4b-4a6e1ef4f67d'}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:44 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8c47b34-89ed-4e00-8007-1f8df779f755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:44 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-7ce21c1e-81d3-4282-875e-2698a09d3e4a tempest-VolumesSnapshotTestJSON-1450209302 None] Creating offline snapshot 1de39625-dc89-4e4c-877b-4fcbd32d3a8c of volume 8c46cc74-4a65-4ddf-adc2-04c040dc22c2 {{(pid=84248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 04:46:44 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Volume volume-08e995cf-e5b7-4d72-b117-dae91ad23ecf (08e995cf-e5b7-4d72-b117-dae91ad23ecf): created successfully
Feb 28 04:46:44 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8c47b34-89ed-4e00-8007-1f8df779f755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:44 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Flow 'volume_create_manager' (2c348297-f1ee-4d36-b7dc-a72513e23ccf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:46:44 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[33767411-d4bd-49cc-a582-3e7dc099e0b3]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7ce21c1e-81d3-4282-875e-2698a09d3e4a tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:44 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-d0b2b37e-d471-4cdb-9f5d-1c852370d4ab tempest-VolumeDependencyTests-162807668 None] Created volume successfully.
Feb 28 04:46:44 devstack sudo[89677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2
Feb 28 04:46:44 devstack sudo[89677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:45 devstack sudo[89673]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f263cddf-3a82-4f14-8af3-bb3a5caffe14 tempest-VolumesSnapshotListTestJSON-925414587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.7994f0b2-008d-4241-aebd-1e41855e67cf" returned: 0 in 0.453s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f263cddf-3a82-4f14-8af3-bb3a5caffe14 tempest-VolumesSnapshotListTestJSON-925414587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.7994f0b2-008d-4241-aebd-1e41855e67cf {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:45 devstack sudo[89682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.7994f0b2-008d-4241-aebd-1e41855e67cf
Feb 28 04:46:45 devstack sudo[89682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:45 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-e81db28f-ca36-43ca-8df3-d9d75c50f0cf tempest-VolumeDependencyTests-162807668 None] Acquiring lock "cinder-98ec4d17-effd-4607-bd4b-4a6e1ef4f67d-delete_snapshot" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:45 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-e81db28f-ca36-43ca-8df3-d9d75c50f0cf tempest-VolumeDependencyTests-162807668 None] Lock "cinder-98ec4d17-effd-4607-bd4b-4a6e1ef4f67d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:45 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-e81db28f-ca36-43ca-8df3-d9d75c50f0cf tempest-VolumeDependencyTests-162807668 None] Acquiring lock "cinder-quobyte-19daf867-ea37-47be-b996-2f63864e2d72" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:45 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-e81db28f-ca36-43ca-8df3-d9d75c50f0cf tempest-VolumeDependencyTests-162807668 None] Lock "cinder-quobyte-19daf867-ea37-47be-b996-2f63864e2d72" acquired by "delete_snapshot" :: waited 0.007s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:45 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-e81db28f-ca36-43ca-8df3-d9d75c50f0cf tempest-VolumeDependencyTests-162807668 None] Acquiring lock "cinder-quobyte-98ec4d17-effd-4607-bd4b-4a6e1ef4f67d" by "_delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:45 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-e81db28f-ca36-43ca-8df3-d9d75c50f0cf tempest-VolumeDependencyTests-162807668 None] Lock "cinder-quobyte-98ec4d17-effd-4607-bd4b-4a6e1ef4f67d" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:45 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-e81db28f-ca36-43ca-8df3-d9d75c50f0cf tempest-VolumeDependencyTests-162807668 None] Deleting offline snapshot 98ec4d17-effd-4607-bd4b-4a6e1ef4f67d of volume 19daf867-ea37-47be-b996-2f63864e2d72 {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 04:46:45 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-e81db28f-ca36-43ca-8df3-d9d75c50f0cf tempest-VolumeDependencyTests-162807668 None] snapshot_file for this snap is: volume-19daf867-ea37-47be-b996-2f63864e2d72.98ec4d17-effd-4607-bd4b-4a6e1ef4f67d {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 04:46:45 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[b396f148-78d8-4334-8367-2687a3171ae7]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e81db28f-ca36-43ca-8df3-d9d75c50f0cf tempest-VolumeDependencyTests-162807668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72.98ec4d17-effd-4607-bd4b-4a6e1ef4f67d {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:45 devstack sudo[89677]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7ce21c1e-81d3-4282-875e-2698a09d3e4a tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2" returned: 0 in 0.487s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7ce21c1e-81d3-4282-875e-2698a09d3e4a tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2.1de39625-dc89-4e4c-877b-4fcbd32d3a8c 1G {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:45 devstack sudo[89686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72.98ec4d17-effd-4607-bd4b-4a6e1ef4f67d
Feb 28 04:46:45 devstack sudo[89686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:45 devstack sudo[89688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2.1de39625-dc89-4e4c-877b-4fcbd32d3a8c 1G
Feb 28 04:46:45 devstack sudo[89688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:45 devstack sudo[89682]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f263cddf-3a82-4f14-8af3-bb3a5caffe14 tempest-VolumesSnapshotListTestJSON-925414587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.7994f0b2-008d-4241-aebd-1e41855e67cf" returned: 0 in 0.442s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:45 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f263cddf-3a82-4f14-8af3-bb3a5caffe14 tempest-VolumesSnapshotListTestJSON-925414587 None] Lock "cinder-quobyte-7994f0b2-008d-4241-aebd-1e41855e67cf" released by "_delete_snapshot" :: held 2.233s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:45 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f263cddf-3a82-4f14-8af3-bb3a5caffe14 tempest-VolumesSnapshotListTestJSON-925414587 None] Lock "cinder-quobyte-0483b314-d3d9-47ac-b27d-5dfbeaa8911e" released by "delete_snapshot" :: held 2.278s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:45 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-f263cddf-3a82-4f14-8af3-bb3a5caffe14 tempest-VolumesSnapshotListTestJSON-925414587 None] Created reservations ['919a6f66-bcf4-4cb1-8011-6d2fcba6343c', '928f9d1f-7699-4cc1-bc19-efbdb645e251', '41134b1a-74c0-4a1d-bba8-c6c27885d8ff', '241a7a23-438e-4313-9d2f-5c05b0ec6cd5'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:46:45 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-f263cddf-3a82-4f14-8af3-bb3a5caffe14 tempest-VolumesSnapshotListTestJSON-925414587 None] Delete snapshot completed successfully.
Feb 28 04:46:45 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f263cddf-3a82-4f14-8af3-bb3a5caffe14 tempest-VolumesSnapshotListTestJSON-925414587 None] Lock "cinder-7994f0b2-008d-4241-aebd-1e41855e67cf-delete_snapshot" released by "delete_snapshot" :: held 2.390s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:45 devstack sudo[89686]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e81db28f-ca36-43ca-8df3-d9d75c50f0cf tempest-VolumeDependencyTests-162807668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72.98ec4d17-effd-4607-bd4b-4a6e1ef4f67d" returned: 0 in 0.504s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:45 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-e81db28f-ca36-43ca-8df3-d9d75c50f0cf tempest-VolumeDependencyTests-162807668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19daf867-ea37-47be-b996-2f63864e2d72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:46:45 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b7d29c-1261-4fba-a849-8626051eb26b]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e81db28f-ca36-43ca-8df3-d9d75c50f0cf tempest-VolumeDependencyTests-162807668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:45 devstack sudo[89688]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7ce21c1e-81d3-4282-875e-2698a09d3e4a tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2.1de39625-dc89-4e4c-877b-4fcbd32d3a8c 1G" returned: 0 in 0.456s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7ce21c1e-81d3-4282-875e-2698a09d3e4a tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2.1de39625-dc89-4e4c-877b-4fcbd32d3a8c {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:45 devstack sudo[89699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2.1de39625-dc89-4e4c-877b-4fcbd32d3a8c
Feb 28 04:46:45 devstack sudo[89699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:45 devstack sudo[89698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72
Feb 28 04:46:45 devstack sudo[89698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:46 devstack sudo[89699]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:46 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7ce21c1e-81d3-4282-875e-2698a09d3e4a tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2.1de39625-dc89-4e4c-877b-4fcbd32d3a8c" returned: 0 in 0.409s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:46 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-7ce21c1e-81d3-4282-875e-2698a09d3e4a tempest-VolumesSnapshotTestJSON-1450209302 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2.1de39625-dc89-4e4c-877b-4fcbd32d3a8c is being set with open permissions: ugo+rw
Feb 28 04:46:46 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7ce21c1e-81d3-4282-875e-2698a09d3e4a tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2.1de39625-dc89-4e4c-877b-4fcbd32d3a8c {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:46 devstack sudo[89708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2.1de39625-dc89-4e4c-877b-4fcbd32d3a8c
Feb 28 04:46:46 devstack sudo[89708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:46 devstack sudo[89698]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:46 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e81db28f-ca36-43ca-8df3-d9d75c50f0cf tempest-VolumeDependencyTests-162807668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72" returned: 0 in 0.455s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:46 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e81db28f-ca36-43ca-8df3-d9d75c50f0cf tempest-VolumeDependencyTests-162807668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72.98ec4d17-effd-4607-bd4b-4a6e1ef4f67d {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:46 devstack sudo[89710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72.98ec4d17-effd-4607-bd4b-4a6e1ef4f67d
Feb 28 04:46:46 devstack sudo[89710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:46 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6a1a6625-4b30-48ed-bf61-27290c628873 tempest-VolumesSnapshotListTestJSON-925414587 None] Acquiring lock "cinder-2ca963f8-57f3-4857-9299-9c01b37bfbe2-delete_snapshot" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:46 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6a1a6625-4b30-48ed-bf61-27290c628873 tempest-VolumesSnapshotListTestJSON-925414587 None] Lock "cinder-2ca963f8-57f3-4857-9299-9c01b37bfbe2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:46 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6a1a6625-4b30-48ed-bf61-27290c628873 tempest-VolumesSnapshotListTestJSON-925414587 None] Acquiring lock "cinder-quobyte-0483b314-d3d9-47ac-b27d-5dfbeaa8911e" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:46 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6a1a6625-4b30-48ed-bf61-27290c628873 tempest-VolumesSnapshotListTestJSON-925414587 None] Lock "cinder-quobyte-0483b314-d3d9-47ac-b27d-5dfbeaa8911e" acquired by "delete_snapshot" :: waited 0.013s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:46 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6a1a6625-4b30-48ed-bf61-27290c628873 tempest-VolumesSnapshotListTestJSON-925414587 None] Acquiring lock "cinder-quobyte-2ca963f8-57f3-4857-9299-9c01b37bfbe2" by "_delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:46 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6a1a6625-4b30-48ed-bf61-27290c628873 tempest-VolumesSnapshotListTestJSON-925414587 None] Lock "cinder-quobyte-2ca963f8-57f3-4857-9299-9c01b37bfbe2" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:46 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-6a1a6625-4b30-48ed-bf61-27290c628873 tempest-VolumesSnapshotListTestJSON-925414587 None] Deleting offline snapshot 2ca963f8-57f3-4857-9299-9c01b37bfbe2 of volume 0483b314-d3d9-47ac-b27d-5dfbeaa8911e {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 04:46:46 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-6a1a6625-4b30-48ed-bf61-27290c628873 tempest-VolumesSnapshotListTestJSON-925414587 None] snapshot_file for this snap is: volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.2ca963f8-57f3-4857-9299-9c01b37bfbe2 {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 04:46:46 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[26288b20-2bc3-46f5-9402-8d9fd813a852]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:46 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6a1a6625-4b30-48ed-bf61-27290c628873 tempest-VolumesSnapshotListTestJSON-925414587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.2ca963f8-57f3-4857-9299-9c01b37bfbe2 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:46 devstack sudo[89712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.2ca963f8-57f3-4857-9299-9c01b37bfbe2
Feb 28 04:46:46 devstack sudo[89712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:46 devstack sudo[89708]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:46 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7ce21c1e-81d3-4282-875e-2698a09d3e4a tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2.1de39625-dc89-4e4c-877b-4fcbd32d3a8c" returned: 0 in 0.400s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:46 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7ce21c1e-81d3-4282-875e-2698a09d3e4a tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:46 devstack sudo[89718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2.info
Feb 28 04:46:46 devstack sudo[89718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:46 devstack sudo[89710]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:46 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e81db28f-ca36-43ca-8df3-d9d75c50f0cf tempest-VolumeDependencyTests-162807668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72.98ec4d17-effd-4607-bd4b-4a6e1ef4f67d" returned: 0 in 0.484s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:46 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e81db28f-ca36-43ca-8df3-d9d75c50f0cf tempest-VolumeDependencyTests-162807668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72.98ec4d17-effd-4607-bd4b-4a6e1ef4f67d {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:46 devstack sudo[89720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72.98ec4d17-effd-4607-bd4b-4a6e1ef4f67d
Feb 28 04:46:46 devstack sudo[89720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:46 devstack sudo[89712]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:46 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6a1a6625-4b30-48ed-bf61-27290c628873 tempest-VolumesSnapshotListTestJSON-925414587 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.2ca963f8-57f3-4857-9299-9c01b37bfbe2" returned: 0 in 0.509s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:46 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-6a1a6625-4b30-48ed-bf61-27290c628873 tempest-VolumesSnapshotListTestJSON-925414587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:46:46 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5f2d97-efaa-4011-95e4-2d0d7bf764b8]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:46 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6a1a6625-4b30-48ed-bf61-27290c628873 tempest-VolumesSnapshotListTestJSON-925414587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:47 devstack sudo[89725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e
Feb 28 04:46:47 devstack sudo[89725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:47 devstack sudo[89718]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:47 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7ce21c1e-81d3-4282-875e-2698a09d3e4a tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2.info" returned: 0 in 0.402s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:47 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-7ce21c1e-81d3-4282-875e-2698a09d3e4a tempest-VolumesSnapshotTestJSON-1450209302 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2.info is being set with open permissions: ugo+rw
Feb 28 04:46:47 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7ce21c1e-81d3-4282-875e-2698a09d3e4a tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:47 devstack sudo[89728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2.info
Feb 28 04:46:47 devstack sudo[89728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:47 devstack sudo[89720]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:47 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e81db28f-ca36-43ca-8df3-d9d75c50f0cf tempest-VolumeDependencyTests-162807668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72.98ec4d17-effd-4607-bd4b-4a6e1ef4f67d" returned: 0 in 0.421s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:47 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-e81db28f-ca36-43ca-8df3-d9d75c50f0cf tempest-VolumeDependencyTests-162807668 None] Lock "cinder-quobyte-98ec4d17-effd-4607-bd4b-4a6e1ef4f67d" released by "_delete_snapshot" :: held 1.931s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:47 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-e81db28f-ca36-43ca-8df3-d9d75c50f0cf tempest-VolumeDependencyTests-162807668 None] Lock "cinder-quobyte-19daf867-ea37-47be-b996-2f63864e2d72" released by "delete_snapshot" :: held 1.941s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:47 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-e81db28f-ca36-43ca-8df3-d9d75c50f0cf tempest-VolumeDependencyTests-162807668 None] Created reservations ['f022a9e2-de48-416c-85b1-62b33166f460', '8a747525-46ba-4a95-87fa-db8c2f808862', '3b65ae54-9381-49a4-9add-ff1937f969e3', 'ffac4ce9-4b50-436b-88fd-75c72432921e'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:46:47 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-e81db28f-ca36-43ca-8df3-d9d75c50f0cf tempest-VolumeDependencyTests-162807668 None] Delete snapshot completed successfully.
Feb 28 04:46:47 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-e81db28f-ca36-43ca-8df3-d9d75c50f0cf tempest-VolumeDependencyTests-162807668 None] Lock "cinder-98ec4d17-effd-4607-bd4b-4a6e1ef4f67d-delete_snapshot" released by "delete_snapshot" :: held 2.014s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:47 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d4e0a47b-5d5c-48b4-a841-adf98e019354 tempest-VolumeDependencyTests-162807668 None] Acquiring lock "cinder-19daf867-ea37-47be-b996-2f63864e2d72-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:47 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d4e0a47b-5d5c-48b4-a841-adf98e019354 tempest-VolumeDependencyTests-162807668 None] Lock "cinder-19daf867-ea37-47be-b996-2f63864e2d72-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:47 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d4e0a47b-5d5c-48b4-a841-adf98e019354 tempest-VolumeDependencyTests-162807668 None] Acquiring lock "cinder-quobyte-19daf867-ea37-47be-b996-2f63864e2d72" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:47 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d4e0a47b-5d5c-48b4-a841-adf98e019354 tempest-VolumeDependencyTests-162807668 None] Lock "cinder-quobyte-19daf867-ea37-47be-b996-2f63864e2d72" acquired by "delete_volume" :: waited 0.013s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:47 devstack sudo[89725]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:47 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6a1a6625-4b30-48ed-bf61-27290c628873 tempest-VolumesSnapshotListTestJSON-925414587 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e" returned: 0 in 0.509s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:47 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6a1a6625-4b30-48ed-bf61-27290c628873 tempest-VolumesSnapshotListTestJSON-925414587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.2ca963f8-57f3-4857-9299-9c01b37bfbe2 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:47 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9e93b5-bfd4-4c97-b721-7efb781fdaf1]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:47 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d4e0a47b-5d5c-48b4-a841-adf98e019354 tempest-VolumeDependencyTests-162807668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:47 devstack sudo[89734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.2ca963f8-57f3-4857-9299-9c01b37bfbe2
Feb 28 04:46:47 devstack sudo[89734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:47 devstack sudo[89737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72
Feb 28 04:46:47 devstack sudo[89737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:47 devstack sudo[89728]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:47 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7ce21c1e-81d3-4282-875e-2698a09d3e4a tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2.info" returned: 0 in 0.476s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:47 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-7ce21c1e-81d3-4282-875e-2698a09d3e4a tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.712s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:47 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-064138f3-193a-43d7-a398-e96b144386c8 tempest-VolumesTransfersTest-2081745280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.057s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:47 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-064138f3-193a-43d7-a398-e96b144386c8 tempest-VolumesTransfersTest-2081745280 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1491323562',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dfac74d-1d1c-4054-8c3d-8d7825466387,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef5f45fe60ea4c06a2a1e6f63864a383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:46:44Z,use_quota=True,user_id='390498d702294e7f880c15e10b4968cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:46:47 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-064138f3-193a-43d7-a398-e96b144386c8 tempest-VolumesTransfersTest-2081745280 None] Creating volume 1dfac74d-1d1c-4054-8c3d-8d7825466387 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:46:47 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-064138f3-193a-43d7-a398-e96b144386c8 tempest-VolumesTransfersTest-2081745280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:47 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-064138f3-193a-43d7-a398-e96b144386c8 tempest-VolumesTransfersTest-2081745280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:47 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-064138f3-193a-43d7-a398-e96b144386c8 tempest-VolumesTransfersTest-2081745280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:46:47 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-064138f3-193a-43d7-a398-e96b144386c8 tempest-VolumesTransfersTest-2081745280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:46:47 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-064138f3-193a-43d7-a398-e96b144386c8 tempest-VolumesTransfersTest-2081745280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:47 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-064138f3-193a-43d7-a398-e96b144386c8 tempest-VolumesTransfersTest-2081745280 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:46:47 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-064138f3-193a-43d7-a398-e96b144386c8 tempest-VolumesTransfersTest-2081745280 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:46:47 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-064138f3-193a-43d7-a398-e96b144386c8 tempest-VolumesTransfersTest-2081745280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1dfac74d-1d1c-4054-8c3d-8d7825466387 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:47 devstack sudo[89739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1dfac74d-1d1c-4054-8c3d-8d7825466387 1073741824
Feb 28 04:46:47 devstack sudo[89739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:47 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-7ce21c1e-81d3-4282-875e-2698a09d3e4a tempest-VolumesSnapshotTestJSON-1450209302 None] Create snapshot completed successfully
Feb 28 04:46:47 devstack sudo[89734]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:47 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6a1a6625-4b30-48ed-bf61-27290c628873 tempest-VolumesSnapshotListTestJSON-925414587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.2ca963f8-57f3-4857-9299-9c01b37bfbe2" returned: 0 in 0.448s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:47 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6a1a6625-4b30-48ed-bf61-27290c628873 tempest-VolumesSnapshotListTestJSON-925414587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.2ca963f8-57f3-4857-9299-9c01b37bfbe2 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:47 devstack sudo[89747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.2ca963f8-57f3-4857-9299-9c01b37bfbe2
Feb 28 04:46:47 devstack sudo[89747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:47 devstack sudo[89737]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:47 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d4e0a47b-5d5c-48b4-a841-adf98e019354 tempest-VolumeDependencyTests-162807668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72" returned: 0 in 0.472s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:47 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d4e0a47b-5d5c-48b4-a841-adf98e019354 tempest-VolumeDependencyTests-162807668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:47 devstack sudo[89751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72
Feb 28 04:46:47 devstack sudo[89751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:48 devstack sudo[89739]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-064138f3-193a-43d7-a398-e96b144386c8 tempest-VolumesTransfersTest-2081745280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1dfac74d-1d1c-4054-8c3d-8d7825466387 1073741824" returned: 0 in 0.502s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-064138f3-193a-43d7-a398-e96b144386c8 tempest-VolumesTransfersTest-2081745280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1dfac74d-1d1c-4054-8c3d-8d7825466387 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:48 devstack sudo[89754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1dfac74d-1d1c-4054-8c3d-8d7825466387
Feb 28 04:46:48 devstack sudo[89754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-a0bd4855-9e3d-4f9e-b04c-4bcf82518573 tempest-VolumesSnapshotTestJSON-1450209302 None] Acquiring lock "cinder-1de39625-dc89-4e4c-877b-4fcbd32d3a8c-delete_snapshot" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-a0bd4855-9e3d-4f9e-b04c-4bcf82518573 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "cinder-1de39625-dc89-4e4c-877b-4fcbd32d3a8c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-a0bd4855-9e3d-4f9e-b04c-4bcf82518573 tempest-VolumesSnapshotTestJSON-1450209302 None] Acquiring lock "cinder-quobyte-8c46cc74-4a65-4ddf-adc2-04c040dc22c2" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-a0bd4855-9e3d-4f9e-b04c-4bcf82518573 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "cinder-quobyte-8c46cc74-4a65-4ddf-adc2-04c040dc22c2" acquired by "delete_snapshot" :: waited 0.006s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-a0bd4855-9e3d-4f9e-b04c-4bcf82518573 tempest-VolumesSnapshotTestJSON-1450209302 None] Acquiring lock "cinder-quobyte-1de39625-dc89-4e4c-877b-4fcbd32d3a8c" by "_delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-a0bd4855-9e3d-4f9e-b04c-4bcf82518573 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "cinder-quobyte-1de39625-dc89-4e4c-877b-4fcbd32d3a8c" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-a0bd4855-9e3d-4f9e-b04c-4bcf82518573 tempest-VolumesSnapshotTestJSON-1450209302 None] Deleting offline snapshot 1de39625-dc89-4e4c-877b-4fcbd32d3a8c of volume 8c46cc74-4a65-4ddf-adc2-04c040dc22c2 {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-a0bd4855-9e3d-4f9e-b04c-4bcf82518573 tempest-VolumesSnapshotTestJSON-1450209302 None] snapshot_file for this snap is: volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2.1de39625-dc89-4e4c-877b-4fcbd32d3a8c {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac4f868-f657-4ec9-a3cf-8c4b6bb76524]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a0bd4855-9e3d-4f9e-b04c-4bcf82518573 tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2.1de39625-dc89-4e4c-877b-4fcbd32d3a8c {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:48 devstack sudo[89756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2.1de39625-dc89-4e4c-877b-4fcbd32d3a8c
Feb 28 04:46:48 devstack sudo[89756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:48 devstack sudo[89747]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6a1a6625-4b30-48ed-bf61-27290c628873 tempest-VolumesSnapshotListTestJSON-925414587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e.2ca963f8-57f3-4857-9299-9c01b37bfbe2" returned: 0 in 0.445s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6a1a6625-4b30-48ed-bf61-27290c628873 tempest-VolumesSnapshotListTestJSON-925414587 None] Lock "cinder-quobyte-2ca963f8-57f3-4857-9299-9c01b37bfbe2" released by "_delete_snapshot" :: held 1.960s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6a1a6625-4b30-48ed-bf61-27290c628873 tempest-VolumesSnapshotListTestJSON-925414587 None] Lock "cinder-quobyte-0483b314-d3d9-47ac-b27d-5dfbeaa8911e" released by "delete_snapshot" :: held 1.971s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-6a1a6625-4b30-48ed-bf61-27290c628873 tempest-VolumesSnapshotListTestJSON-925414587 None] Created reservations ['47498391-a966-4483-9203-73a23bb8ff56', '3f9afd71-cacb-4b89-85cc-be89e82fe2d2', '2f59967b-cab0-4df6-b674-4248c8d5810b', 'a6e60910-20fb-4d45-84bf-d190ae7bb7f5'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:46:48 devstack sudo[89751]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d4e0a47b-5d5c-48b4-a841-adf98e019354 tempest-VolumeDependencyTests-162807668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-19daf867-ea37-47be-b996-2f63864e2d72" returned: 0 in 0.476s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d4e0a47b-5d5c-48b4-a841-adf98e019354 tempest-VolumeDependencyTests-162807668 None] Lock "cinder-quobyte-19daf867-ea37-47be-b996-2f63864e2d72" released by "delete_volume" :: held 0.988s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:48 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-6a1a6625-4b30-48ed-bf61-27290c628873 tempest-VolumesSnapshotListTestJSON-925414587 None] Delete snapshot completed successfully.
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-d4e0a47b-5d5c-48b4-a841-adf98e019354 tempest-VolumeDependencyTests-162807668 None] Created reservations ['79c7f20d-5bfe-4af5-a63e-5f5cd49b86bc', '53d2e3e5-c2e5-488e-ac24-06b715a54492', '1debb78e-5d1c-46e3-b8aa-dd157bbb782b', '1bdffdc9-ded0-4323-a25f-f3f16933f7d3'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6a1a6625-4b30-48ed-bf61-27290c628873 tempest-VolumesSnapshotListTestJSON-925414587 None] Lock "cinder-2ca963f8-57f3-4857-9299-9c01b37bfbe2-delete_snapshot" released by "delete_snapshot" :: held 2.106s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d4e0a47b-5d5c-48b4-a841-adf98e019354 tempest-VolumeDependencyTests-162807668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d4e0a47b-5d5c-48b4-a841-adf98e019354 tempest-VolumeDependencyTests-162807668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-d4e0a47b-5d5c-48b4-a841-adf98e019354 tempest-VolumeDependencyTests-162807668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-d4e0a47b-5d5c-48b4-a841-adf98e019354 tempest-VolumeDependencyTests-162807668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d4e0a47b-5d5c-48b4-a841-adf98e019354 tempest-VolumeDependencyTests-162807668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d4e0a47b-5d5c-48b4-a841-adf98e019354 tempest-VolumeDependencyTests-162807668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-609a361e-171d-47da-9e1c-e2e26eb15f5c tempest-VolumesSnapshotListTestJSON-925414587 None] Acquiring lock "cinder-0483b314-d3d9-47ac-b27d-5dfbeaa8911e-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-609a361e-171d-47da-9e1c-e2e26eb15f5c tempest-VolumesSnapshotListTestJSON-925414587 None] Lock "cinder-0483b314-d3d9-47ac-b27d-5dfbeaa8911e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:48 devstack sudo[89761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:46:48 devstack sudo[89761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-609a361e-171d-47da-9e1c-e2e26eb15f5c tempest-VolumesSnapshotListTestJSON-925414587 None] Acquiring lock "cinder-quobyte-0483b314-d3d9-47ac-b27d-5dfbeaa8911e" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-609a361e-171d-47da-9e1c-e2e26eb15f5c tempest-VolumesSnapshotListTestJSON-925414587 None] Lock "cinder-quobyte-0483b314-d3d9-47ac-b27d-5dfbeaa8911e" acquired by "delete_volume" :: waited 0.007s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:48 devstack sudo[89754]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-064138f3-193a-43d7-a398-e96b144386c8 tempest-VolumesTransfersTest-2081745280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1dfac74d-1d1c-4054-8c3d-8d7825466387" returned: 0 in 0.514s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-064138f3-193a-43d7-a398-e96b144386c8 tempest-VolumesTransfersTest-2081745280 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-064138f3-193a-43d7-a398-e96b144386c8 tempest-VolumesTransfersTest-2081745280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eaacbf3-59da-48fa-b418-9f121d90e7af]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-609a361e-171d-47da-9e1c-e2e26eb15f5c tempest-VolumesSnapshotListTestJSON-925414587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-064138f3-193a-43d7-a398-e96b144386c8 tempest-VolumesTransfersTest-2081745280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1948b40d-1ee9-44b4-abfb-01e16f96aa76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dfac74d-1d1c-4054-8c3d-8d7825466387', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-064138f3-193a-43d7-a398-e96b144386c8 tempest-VolumesTransfersTest-2081745280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (477f5417-fa81-4a46-82e4-8889c996c76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:48 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-064138f3-193a-43d7-a398-e96b144386c8 tempest-VolumesTransfersTest-2081745280 None] Volume volume-1dfac74d-1d1c-4054-8c3d-8d7825466387 (1dfac74d-1d1c-4054-8c3d-8d7825466387): created successfully
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-064138f3-193a-43d7-a398-e96b144386c8 tempest-VolumesTransfersTest-2081745280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (477f5417-fa81-4a46-82e4-8889c996c76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-064138f3-193a-43d7-a398-e96b144386c8 tempest-VolumesTransfersTest-2081745280 None] Flow 'volume_create_manager' (de6af4ad-c9ef-4348-92b6-14588752a07c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:46:48 devstack sudo[89763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e
Feb 28 04:46:48 devstack sudo[89763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:48 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-064138f3-193a-43d7-a398-e96b144386c8 tempest-VolumesTransfersTest-2081745280 None] Created volume successfully.
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-09a5fb58-d264-4259-9f56-dd0ea09cb13d tempest-VolumeDependencyTests-162807668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-09a5fb58-d264-4259-9f56-dd0ea09cb13d tempest-VolumeDependencyTests-162807668 None] Flow 'volume_create_manager' (a1c96596-1810-4dc4-a767-c81b5278ca77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-09a5fb58-d264-4259-9f56-dd0ea09cb13d tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d58fc096-d880-430a-af0d-925dd2487c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-09a5fb58-d264-4259-9f56-dd0ea09cb13d tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d58fc096-d880-430a-af0d-925dd2487c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1883286638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e04159a6-93ad-4f41-9fa5-6acfc113db85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f43d0cbb6ae04f61a534ccddb799a55a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:46:49Z,use_quota=True,user_id='08fd9f1d4efd4e3e98df0bea509eb225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:48 devstack sudo[89756]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-09a5fb58-d264-4259-9f56-dd0ea09cb13d tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99451b29-9c62-478e-bfff-b421e284de6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-09a5fb58-d264-4259-9f56-dd0ea09cb13d tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99451b29-9c62-478e-bfff-b421e284de6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-09a5fb58-d264-4259-9f56-dd0ea09cb13d tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9833fa6-0a5c-4ae4-9cdb-d7a8020cef9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-09a5fb58-d264-4259-9f56-dd0ea09cb13d tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9833fa6-0a5c-4ae4-9cdb-d7a8020cef9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e04159a6-93ad-4f41-9fa5-6acfc113db85', 'volume_name': 'volume-e04159a6-93ad-4f41-9fa5-6acfc113db85', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-09a5fb58-d264-4259-9f56-dd0ea09cb13d tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04bdffe5-0808-4b59-afe4-4091df927d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-09a5fb58-d264-4259-9f56-dd0ea09cb13d tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04bdffe5-0808-4b59-afe4-4091df927d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-09a5fb58-d264-4259-9f56-dd0ea09cb13d tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32b0f3d9-bfd3-4d44-b0f9-41d94e7989a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:48 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-09a5fb58-d264-4259-9f56-dd0ea09cb13d tempest-VolumeDependencyTests-162807668 None] Volume e04159a6-93ad-4f41-9fa5-6acfc113db85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e04159a6-93ad-4f41-9fa5-6acfc113db85', 'volume_size': 1}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-09a5fb58-d264-4259-9f56-dd0ea09cb13d tempest-VolumeDependencyTests-162807668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-09a5fb58-d264-4259-9f56-dd0ea09cb13d tempest-VolumeDependencyTests-162807668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-09a5fb58-d264-4259-9f56-dd0ea09cb13d tempest-VolumeDependencyTests-162807668 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1883286638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e04159a6-93ad-4f41-9fa5-6acfc113db85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f43d0cbb6ae04f61a534ccddb799a55a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:46:49Z,use_quota=True,user_id='08fd9f1d4efd4e3e98df0bea509eb225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-09a5fb58-d264-4259-9f56-dd0ea09cb13d tempest-VolumeDependencyTests-162807668 None] Creating volume e04159a6-93ad-4f41-9fa5-6acfc113db85 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-09a5fb58-d264-4259-9f56-dd0ea09cb13d tempest-VolumeDependencyTests-162807668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-09a5fb58-d264-4259-9f56-dd0ea09cb13d tempest-VolumeDependencyTests-162807668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-09a5fb58-d264-4259-9f56-dd0ea09cb13d tempest-VolumeDependencyTests-162807668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-09a5fb58-d264-4259-9f56-dd0ea09cb13d tempest-VolumeDependencyTests-162807668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-09a5fb58-d264-4259-9f56-dd0ea09cb13d tempest-VolumeDependencyTests-162807668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-09a5fb58-d264-4259-9f56-dd0ea09cb13d tempest-VolumeDependencyTests-162807668 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:46:48 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-09a5fb58-d264-4259-9f56-dd0ea09cb13d tempest-VolumeDependencyTests-162807668 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-09a5fb58-d264-4259-9f56-dd0ea09cb13d tempest-VolumeDependencyTests-162807668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a0bd4855-9e3d-4f9e-b04c-4bcf82518573 tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2.1de39625-dc89-4e4c-877b-4fcbd32d3a8c" returned: 0 in 0.696s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-a0bd4855-9e3d-4f9e-b04c-4bcf82518573 tempest-VolumesSnapshotTestJSON-1450209302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:46:48 devstack sudo[89768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85 1073741824
Feb 28 04:46:48 devstack sudo[89768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[2116787d-245a-40d8-8dd3-a4787a1c9b7d]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:48 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a0bd4855-9e3d-4f9e-b04c-4bcf82518573 tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:49 devstack sudo[89770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2
Feb 28 04:46:49 devstack sudo[89770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:49 devstack sudo[89761]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d4e0a47b-5d5c-48b4-a841-adf98e019354 tempest-VolumeDependencyTests-162807668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.560s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:49 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-d4e0a47b-5d5c-48b4-a841-adf98e019354 tempest-VolumeDependencyTests-162807668 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:46:49 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-d4e0a47b-5d5c-48b4-a841-adf98e019354 tempest-VolumeDependencyTests-162807668 None] Deleted volume successfully.
Feb 28 04:46:49 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d4e0a47b-5d5c-48b4-a841-adf98e019354 tempest-VolumeDependencyTests-162807668 None] Lock "cinder-19daf867-ea37-47be-b996-2f63864e2d72-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:49 devstack sudo[89763]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-609a361e-171d-47da-9e1c-e2e26eb15f5c tempest-VolumesSnapshotListTestJSON-925414587 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e" returned: 0 in 0.544s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-609a361e-171d-47da-9e1c-e2e26eb15f5c tempest-VolumesSnapshotListTestJSON-925414587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:49 devstack sudo[89776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e
Feb 28 04:46:49 devstack sudo[89776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:49 devstack sudo[89768]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-09a5fb58-d264-4259-9f56-dd0ea09cb13d tempest-VolumeDependencyTests-162807668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85 1073741824" returned: 0 in 0.479s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-09a5fb58-d264-4259-9f56-dd0ea09cb13d tempest-VolumeDependencyTests-162807668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:49 devstack sudo[89784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85
Feb 28 04:46:49 devstack sudo[89784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:49 devstack sudo[89770]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a0bd4855-9e3d-4f9e-b04c-4bcf82518573 tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2" returned: 0 in 0.504s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a0bd4855-9e3d-4f9e-b04c-4bcf82518573 tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2.1de39625-dc89-4e4c-877b-4fcbd32d3a8c {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:49 devstack sudo[89786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2.1de39625-dc89-4e4c-877b-4fcbd32d3a8c
Feb 28 04:46:49 devstack sudo[89786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:49 devstack sudo[89776]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-609a361e-171d-47da-9e1c-e2e26eb15f5c tempest-VolumesSnapshotListTestJSON-925414587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-0483b314-d3d9-47ac-b27d-5dfbeaa8911e" returned: 0 in 0.420s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:49 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-609a361e-171d-47da-9e1c-e2e26eb15f5c tempest-VolumesSnapshotListTestJSON-925414587 None] Lock "cinder-quobyte-0483b314-d3d9-47ac-b27d-5dfbeaa8911e" released by "delete_volume" :: held 1.004s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:49 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-609a361e-171d-47da-9e1c-e2e26eb15f5c tempest-VolumesSnapshotListTestJSON-925414587 None] Created reservations ['b58dfa31-faf5-49bd-a75a-17b8ba4a3ac5', 'decc13f6-f614-48b6-9956-eeb05558ce7f', '45ce44b4-99cb-47c2-a368-8f4640bb391e', '7d87ad4e-3eab-4cc9-87de-cf3a0ddef9dc'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:46:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-609a361e-171d-47da-9e1c-e2e26eb15f5c tempest-VolumesSnapshotListTestJSON-925414587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-609a361e-171d-47da-9e1c-e2e26eb15f5c tempest-VolumesSnapshotListTestJSON-925414587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:49 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-609a361e-171d-47da-9e1c-e2e26eb15f5c tempest-VolumesSnapshotListTestJSON-925414587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:46:49 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-609a361e-171d-47da-9e1c-e2e26eb15f5c tempest-VolumesSnapshotListTestJSON-925414587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:46:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-609a361e-171d-47da-9e1c-e2e26eb15f5c tempest-VolumesSnapshotListTestJSON-925414587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-609a361e-171d-47da-9e1c-e2e26eb15f5c tempest-VolumesSnapshotListTestJSON-925414587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:49 devstack sudo[89789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:46:49 devstack sudo[89789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:49 devstack sudo[89784]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-09a5fb58-d264-4259-9f56-dd0ea09cb13d tempest-VolumeDependencyTests-162807668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85" returned: 0 in 0.447s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:49 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-09a5fb58-d264-4259-9f56-dd0ea09cb13d tempest-VolumeDependencyTests-162807668 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:46:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-09a5fb58-d264-4259-9f56-dd0ea09cb13d tempest-VolumeDependencyTests-162807668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:49 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-09a5fb58-d264-4259-9f56-dd0ea09cb13d tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32b0f3d9-bfd3-4d44-b0f9-41d94e7989a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e04159a6-93ad-4f41-9fa5-6acfc113db85', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:49 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-09a5fb58-d264-4259-9f56-dd0ea09cb13d tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6311513-9052-4e19-a156-b83a94ad4953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:49 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-09a5fb58-d264-4259-9f56-dd0ea09cb13d tempest-VolumeDependencyTests-162807668 None] Volume volume-e04159a6-93ad-4f41-9fa5-6acfc113db85 (e04159a6-93ad-4f41-9fa5-6acfc113db85): created successfully
Feb 28 04:46:49 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-09a5fb58-d264-4259-9f56-dd0ea09cb13d tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6311513-9052-4e19-a156-b83a94ad4953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:49 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-09a5fb58-d264-4259-9f56-dd0ea09cb13d tempest-VolumeDependencyTests-162807668 None] Flow 'volume_create_manager' (a1c96596-1810-4dc4-a767-c81b5278ca77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:46:49 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-09a5fb58-d264-4259-9f56-dd0ea09cb13d tempest-VolumeDependencyTests-162807668 None] Created volume successfully.
Feb 28 04:46:50 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-fcb6fb74-a10a-40d7-bf5d-f07d6965a8e1 tempest-VolumesTransfersTest-505765435 None] Acquiring lock "cinder-1dfac74d-1d1c-4054-8c3d-8d7825466387-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:50 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-fcb6fb74-a10a-40d7-bf5d-f07d6965a8e1 tempest-VolumesTransfersTest-505765435 None] Lock "cinder-1dfac74d-1d1c-4054-8c3d-8d7825466387-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:50 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-fcb6fb74-a10a-40d7-bf5d-f07d6965a8e1 tempest-VolumesTransfersTest-505765435 None] Acquiring lock "cinder-quobyte-1dfac74d-1d1c-4054-8c3d-8d7825466387" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:50 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-fcb6fb74-a10a-40d7-bf5d-f07d6965a8e1 tempest-VolumesTransfersTest-505765435 None] Lock "cinder-quobyte-1dfac74d-1d1c-4054-8c3d-8d7825466387" acquired by "delete_volume" :: waited 0.007s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:50 devstack sudo[89786]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:50 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49d56fd-7292-48c8-928f-4966310c1098]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-fcb6fb74-a10a-40d7-bf5d-f07d6965a8e1 tempest-VolumesTransfersTest-505765435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1dfac74d-1d1c-4054-8c3d-8d7825466387 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a0bd4855-9e3d-4f9e-b04c-4bcf82518573 tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2.1de39625-dc89-4e4c-877b-4fcbd32d3a8c" returned: 0 in 0.642s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a0bd4855-9e3d-4f9e-b04c-4bcf82518573 tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2.1de39625-dc89-4e4c-877b-4fcbd32d3a8c {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:50 devstack sudo[89797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2.1de39625-dc89-4e4c-877b-4fcbd32d3a8c
Feb 28 04:46:50 devstack sudo[89797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:50 devstack sudo[89796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1dfac74d-1d1c-4054-8c3d-8d7825466387
Feb 28 04:46:50 devstack sudo[89796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:50 devstack sudo[89789]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-609a361e-171d-47da-9e1c-e2e26eb15f5c tempest-VolumesSnapshotListTestJSON-925414587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.569s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:50 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-609a361e-171d-47da-9e1c-e2e26eb15f5c tempest-VolumesSnapshotListTestJSON-925414587 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:46:50 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-609a361e-171d-47da-9e1c-e2e26eb15f5c tempest-VolumesSnapshotListTestJSON-925414587 None] Deleted volume successfully.
Feb 28 04:46:50 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-609a361e-171d-47da-9e1c-e2e26eb15f5c tempest-VolumesSnapshotListTestJSON-925414587 None] Lock "cinder-0483b314-d3d9-47ac-b27d-5dfbeaa8911e-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:50 devstack sudo[89797]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a0bd4855-9e3d-4f9e-b04c-4bcf82518573 tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2.1de39625-dc89-4e4c-877b-4fcbd32d3a8c" returned: 0 in 0.491s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:50 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-a0bd4855-9e3d-4f9e-b04c-4bcf82518573 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "cinder-quobyte-1de39625-dc89-4e4c-877b-4fcbd32d3a8c" released by "_delete_snapshot" :: held 2.396s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:50 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-a0bd4855-9e3d-4f9e-b04c-4bcf82518573 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "cinder-quobyte-8c46cc74-4a65-4ddf-adc2-04c040dc22c2" released by "delete_snapshot" :: held 2.406s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:50 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-a0bd4855-9e3d-4f9e-b04c-4bcf82518573 tempest-VolumesSnapshotTestJSON-1450209302 None] Created reservations ['0facc362-cb62-41a8-833f-ffbc1bef1d6b', '7c489641-0878-4777-ae4b-3ad89c8976ae', '6d96bd53-7a38-4e2e-848c-0bf9707a742c', '09e81133-6e12-4942-a043-ee8f75b2b07a'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:46:50 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-a0bd4855-9e3d-4f9e-b04c-4bcf82518573 tempest-VolumesSnapshotTestJSON-1450209302 None] Delete snapshot completed successfully.
Feb 28 04:46:50 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-a0bd4855-9e3d-4f9e-b04c-4bcf82518573 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "cinder-1de39625-dc89-4e4c-877b-4fcbd32d3a8c-delete_snapshot" released by "delete_snapshot" :: held 2.502s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:50 devstack sudo[89796]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-fcb6fb74-a10a-40d7-bf5d-f07d6965a8e1 tempest-VolumesTransfersTest-505765435 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1dfac74d-1d1c-4054-8c3d-8d7825466387" returned: 0 in 0.618s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-fcb6fb74-a10a-40d7-bf5d-f07d6965a8e1 tempest-VolumesTransfersTest-505765435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1dfac74d-1d1c-4054-8c3d-8d7825466387 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:50 devstack sudo[89806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1dfac74d-1d1c-4054-8c3d-8d7825466387
Feb 28 04:46:50 devstack sudo[89806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:51 devstack sudo[89806]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-fcb6fb74-a10a-40d7-bf5d-f07d6965a8e1 tempest-VolumesTransfersTest-505765435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1dfac74d-1d1c-4054-8c3d-8d7825466387" returned: 0 in 0.506s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-fcb6fb74-a10a-40d7-bf5d-f07d6965a8e1 tempest-VolumesTransfersTest-505765435 None] Lock "cinder-quobyte-1dfac74d-1d1c-4054-8c3d-8d7825466387" released by "delete_volume" :: held 1.155s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-fcb6fb74-a10a-40d7-bf5d-f07d6965a8e1 tempest-VolumesTransfersTest-505765435 None] Created reservations ['8ddffead-9e66-4990-90d7-26a5f7006256', 'f66dc0f5-1458-4779-8009-85aab779b13d', '0d82eb83-2eaf-4389-a029-d236c6131084', '3c7674ff-2505-4e59-aa89-6be3171a92e5'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-fcb6fb74-a10a-40d7-bf5d-f07d6965a8e1 tempest-VolumesTransfersTest-505765435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-fcb6fb74-a10a-40d7-bf5d-f07d6965a8e1 tempest-VolumesTransfersTest-505765435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-fcb6fb74-a10a-40d7-bf5d-f07d6965a8e1 tempest-VolumesTransfersTest-505765435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-fcb6fb74-a10a-40d7-bf5d-f07d6965a8e1 tempest-VolumesTransfersTest-505765435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-fcb6fb74-a10a-40d7-bf5d-f07d6965a8e1 tempest-VolumesTransfersTest-505765435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-fcb6fb74-a10a-40d7-bf5d-f07d6965a8e1 tempest-VolumesTransfersTest-505765435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Flow 'volume_create_manager' (025b0379-d1ae-4caa-9646-53f71e7e8e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff808c87-9533-4bc4-a2cd-fa6b2e933e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:51 devstack sudo[89810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:46:51 devstack sudo[89810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff808c87-9533-4bc4-a2cd-fa6b2e933e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:46:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-468420808',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d69d36f-3bb0-4e34-adbe-6e01cc187521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f43d0cbb6ae04f61a534ccddb799a55a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=e04159a6-93ad-4f41-9fa5-6acfc113db85,status='creating',terminated_at=None,updated_at=2026-02-28T03:46:51Z,use_quota=True,user_id='08fd9f1d4efd4e3e98df0bea509eb225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2999013d-9b0c-4232-92a4-ec4732ad07de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2999013d-9b0c-4232-92a4-ec4732ad07de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38f4951f-339e-4c54-8f35-52cceb9f3703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38f4951f-339e-4c54-8f35-52cceb9f3703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9d69d36f-3bb0-4e34-adbe-6e01cc187521', 'volume_name': 'volume-9d69d36f-3bb0-4e34-adbe-6e01cc187521', 'volume_size': 1, 'source_volid': 'e04159a6-93ad-4f41-9fa5-6acfc113db85', 'source_volstatus': 'available'}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b39e222-54c2-409d-8218-9696a114fc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b39e222-54c2-409d-8218-9696a114fc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffe8f500-07bb-4912-8e55-c349583795c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:51 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Volume 9d69d36f-3bb0-4e34-adbe-6e01cc187521: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9d69d36f-3bb0-4e34-adbe-6e01cc187521', 'volume_size': 1, 'source_volid': 'e04159a6-93ad-4f41-9fa5-6acfc113db85', 'source_volstatus': 'available'}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:51 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Cloning volume e04159a6-93ad-4f41-9fa5-6acfc113db85 to volume 9d69d36f-3bb0-4e34-adbe-6e01cc187521
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Creating offline snapshot 73faaa4d-856b-4f41-9150-c04e6bc4b2b9 of volume e04159a6-93ad-4f41-9fa5-6acfc113db85 {{(pid=84248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[c904cba1-7367-4f8b-bb4c-4faa969aa745]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:51 devstack sudo[89813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85
Feb 28 04:46:51 devstack sudo[89813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4739a6b-b68b-4ff0-b667-af85d48c0a3d tempest-CreateVolumesFromImageTest-694268940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d4739a6b-b68b-4ff0-b667-af85d48c0a3d tempest-CreateVolumesFromImageTest-694268940 None] Flow 'volume_create_manager' (7c47cbe8-16f7-4533-92f4-d6729528ba53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d4739a6b-b68b-4ff0-b667-af85d48c0a3d tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6c9ca79-5c48-453f-9581-61b772e43da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d4739a6b-b68b-4ff0-b667-af85d48c0a3d tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6c9ca79-5c48-453f-9581-61b772e43da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:46:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1863289710',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79dd7500-d311-4531-a23b-5947776112c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dcbf176efb44c48add6eac981a0c3b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:46:52Z,use_quota=True,user_id='bacc012d1f814f378f9617ad382932a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d4739a6b-b68b-4ff0-b667-af85d48c0a3d tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d7eec57-ef71-4cb7-bfa2-dfdeea4bafc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d4739a6b-b68b-4ff0-b667-af85d48c0a3d tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d7eec57-ef71-4cb7-bfa2-dfdeea4bafc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d4739a6b-b68b-4ff0-b667-af85d48c0a3d tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fa49e9d-6e75-4faa-80b6-9bbe8fe0c015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d4739a6b-b68b-4ff0-b667-af85d48c0a3d tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fa49e9d-6e75-4faa-80b6-9bbe8fe0c015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79dd7500-d311-4531-a23b-5947776112c6', 'volume_name': 'volume-79dd7500-d311-4531-a23b-5947776112c6', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d4739a6b-b68b-4ff0-b667-af85d48c0a3d tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d16f92e-bfc2-41e0-bf9c-8893e7fa7134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d4739a6b-b68b-4ff0-b667-af85d48c0a3d tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d16f92e-bfc2-41e0-bf9c-8893e7fa7134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d4739a6b-b68b-4ff0-b667-af85d48c0a3d tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6925d599-d100-4f5b-a487-d15947985d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:51 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-d4739a6b-b68b-4ff0-b667-af85d48c0a3d tempest-CreateVolumesFromImageTest-694268940 None] Volume 79dd7500-d311-4531-a23b-5947776112c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79dd7500-d311-4531-a23b-5947776112c6', 'volume_size': 1}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d4739a6b-b68b-4ff0-b667-af85d48c0a3d tempest-CreateVolumesFromImageTest-694268940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8a14ae3-a967-41d7-a162-8fe241e05b37 tempest-VolumesSnapshotTestJSON-1450209302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-c8a14ae3-a967-41d7-a162-8fe241e05b37 tempest-VolumesSnapshotTestJSON-1450209302 None] Flow 'volume_create_manager' (ce46e180-0960-4ed2-9a76-9d93371e818d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-c8a14ae3-a967-41d7-a162-8fe241e05b37 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1cba594-1ff9-4a31-bf50-c43ad56da03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-c8a14ae3-a967-41d7-a162-8fe241e05b37 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1cba594-1ff9-4a31-bf50-c43ad56da03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1022067611',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f143321-1a8b-493c-ae41-d891b2af1525,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38e49879b3b24d2d9b0adf1476729ddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:46:52Z,use_quota=True,user_id='5ddc0b80823a4acc8f06430d30a63512',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-c8a14ae3-a967-41d7-a162-8fe241e05b37 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17cd2a97-c095-4c5b-967c-223363df0d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-c8a14ae3-a967-41d7-a162-8fe241e05b37 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17cd2a97-c095-4c5b-967c-223363df0d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-c8a14ae3-a967-41d7-a162-8fe241e05b37 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a3a55bb-f729-4125-a254-96596bb77814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-c8a14ae3-a967-41d7-a162-8fe241e05b37 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a3a55bb-f729-4125-a254-96596bb77814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f143321-1a8b-493c-ae41-d891b2af1525', 'volume_name': 'volume-7f143321-1a8b-493c-ae41-d891b2af1525', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-c8a14ae3-a967-41d7-a162-8fe241e05b37 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f7bf0fa-2082-4c91-86ca-6ce78d3eff7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-c8a14ae3-a967-41d7-a162-8fe241e05b37 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f7bf0fa-2082-4c91-86ca-6ce78d3eff7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-c8a14ae3-a967-41d7-a162-8fe241e05b37 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee365791-d09d-4e12-b5f7-3e15a3490733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:51 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-c8a14ae3-a967-41d7-a162-8fe241e05b37 tempest-VolumesSnapshotTestJSON-1450209302 None] Volume 7f143321-1a8b-493c-ae41-d891b2af1525: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f143321-1a8b-493c-ae41-d891b2af1525', 'volume_size': 1}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-c8a14ae3-a967-41d7-a162-8fe241e05b37 tempest-VolumesSnapshotTestJSON-1450209302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ec82c0d-37ed-4116-a59c-e60e1c3ccb1f tempest-CreateVolumesFromImageTest-694268940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-0ec82c0d-37ed-4116-a59c-e60e1c3ccb1f tempest-CreateVolumesFromImageTest-694268940 None] Flow 'volume_create_manager' (3f9333dd-3f76-46eb-b04e-43a427fc528c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:46:51 devstack sudo[89810]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-0ec82c0d-37ed-4116-a59c-e60e1c3ccb1f tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb273a8a-42b8-4516-84db-2cadb48d0b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-0ec82c0d-37ed-4116-a59c-e60e1c3ccb1f tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb273a8a-42b8-4516-84db-2cadb48d0b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2051045424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49d10e58-6ec2-4a61-bb73-e917f9685638,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dcbf176efb44c48add6eac981a0c3b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:46:52Z,use_quota=True,user_id='bacc012d1f814f378f9617ad382932a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-0ec82c0d-37ed-4116-a59c-e60e1c3ccb1f tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bae4b0bc-88a8-46f1-8ce4-a60da0193152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-0ec82c0d-37ed-4116-a59c-e60e1c3ccb1f tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bae4b0bc-88a8-46f1-8ce4-a60da0193152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-0ec82c0d-37ed-4116-a59c-e60e1c3ccb1f tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b32cf49-b8b5-43c1-82b5-11a638d61b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-0ec82c0d-37ed-4116-a59c-e60e1c3ccb1f tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b32cf49-b8b5-43c1-82b5-11a638d61b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49d10e58-6ec2-4a61-bb73-e917f9685638', 'volume_name': 'volume-49d10e58-6ec2-4a61-bb73-e917f9685638', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-0ec82c0d-37ed-4116-a59c-e60e1c3ccb1f tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e12f7732-7201-4b04-821a-0f3d6d577385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-0ec82c0d-37ed-4116-a59c-e60e1c3ccb1f tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e12f7732-7201-4b04-821a-0f3d6d577385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-0ec82c0d-37ed-4116-a59c-e60e1c3ccb1f tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1177758b-7621-4840-884f-5212a0a0996d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:52 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-0ec82c0d-37ed-4116-a59c-e60e1c3ccb1f tempest-CreateVolumesFromImageTest-694268940 None] Volume 49d10e58-6ec2-4a61-bb73-e917f9685638: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49d10e58-6ec2-4a61-bb73-e917f9685638', 'volume_size': 1}
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-0ec82c0d-37ed-4116-a59c-e60e1c3ccb1f tempest-CreateVolumesFromImageTest-694268940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-fcb6fb74-a10a-40d7-bf5d-f07d6965a8e1 tempest-VolumesTransfersTest-505765435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.645s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-fcb6fb74-a10a-40d7-bf5d-f07d6965a8e1 tempest-VolumesTransfersTest-505765435 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:46:52 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-fcb6fb74-a10a-40d7-bf5d-f07d6965a8e1 tempest-VolumesTransfersTest-505765435 None] Deleted volume successfully.
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-fcb6fb74-a10a-40d7-bf5d-f07d6965a8e1 tempest-VolumesTransfersTest-505765435 None] Lock "cinder-1dfac74d-1d1c-4054-8c3d-8d7825466387-delete_volume" released by "delete_volume" :: held 1.981s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-2256a282-5de1-499b-b9cb-11124d57c60e tempest-CreateVolumesFromImageTest-694268940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-2256a282-5de1-499b-b9cb-11124d57c60e tempest-CreateVolumesFromImageTest-694268940 None] Flow 'volume_create_manager' (49f01de8-c3b4-41bd-bc92-d232807da832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-2256a282-5de1-499b-b9cb-11124d57c60e tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (538ea1f9-9782-4507-836e-593c3973caa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:52 devstack sudo[89813]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-2256a282-5de1-499b-b9cb-11124d57c60e tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (538ea1f9-9782-4507-836e-593c3973caa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1908740673',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44312f19-0476-4652-9b51-d19a60cd57ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dcbf176efb44c48add6eac981a0c3b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:46:52Z,use_quota=True,user_id='bacc012d1f814f378f9617ad382932a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-2256a282-5de1-499b-b9cb-11124d57c60e tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79186601-481a-44c3-a294-1ce1aaf88ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-2256a282-5de1-499b-b9cb-11124d57c60e tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79186601-481a-44c3-a294-1ce1aaf88ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-2256a282-5de1-499b-b9cb-11124d57c60e tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c956694-5166-4e23-b8be-762d7a1b2711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-2256a282-5de1-499b-b9cb-11124d57c60e tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c956694-5166-4e23-b8be-762d7a1b2711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44312f19-0476-4652-9b51-d19a60cd57ce', 'volume_name': 'volume-44312f19-0476-4652-9b51-d19a60cd57ce', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-2256a282-5de1-499b-b9cb-11124d57c60e tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92f00694-f7c4-4428-8946-a14d62b2b2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-2256a282-5de1-499b-b9cb-11124d57c60e tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92f00694-f7c4-4428-8946-a14d62b2b2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-2256a282-5de1-499b-b9cb-11124d57c60e tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ad5382e-79e1-42b9-962e-d767a2d617f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:52 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-2256a282-5de1-499b-b9cb-11124d57c60e tempest-CreateVolumesFromImageTest-694268940 None] Volume 44312f19-0476-4652-9b51-d19a60cd57ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44312f19-0476-4652-9b51-d19a60cd57ce', 'volume_size': 1}
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-2256a282-5de1-499b-b9cb-11124d57c60e tempest-CreateVolumesFromImageTest-694268940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85" returned: 0 in 0.644s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85.73faaa4d-856b-4f41-9150-c04e6bc4b2b9 1G {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:52 devstack sudo[89819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85.73faaa4d-856b-4f41-9150-c04e6bc4b2b9 1G
Feb 28 04:46:52 devstack sudo[89819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d71a21a-bb5c-43ae-96cf-3b07dc1e8075 tempest-CreateVolumesFromImageTest-694268940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3d71a21a-bb5c-43ae-96cf-3b07dc1e8075 tempest-CreateVolumesFromImageTest-694268940 None] Flow 'volume_create_manager' (ad26f77a-64bf-4921-aaac-f8d62c155934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3d71a21a-bb5c-43ae-96cf-3b07dc1e8075 tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e5a046e-52b0-458e-a075-5b122aa0afd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3d71a21a-bb5c-43ae-96cf-3b07dc1e8075 tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e5a046e-52b0-458e-a075-5b122aa0afd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1975093443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dac8202-4328-45da-be0b-4b2eb8ff364e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dcbf176efb44c48add6eac981a0c3b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:46:52Z,use_quota=True,user_id='bacc012d1f814f378f9617ad382932a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3d71a21a-bb5c-43ae-96cf-3b07dc1e8075 tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c9a1a77-b82f-463e-8b5a-cfcde6df17ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3d71a21a-bb5c-43ae-96cf-3b07dc1e8075 tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c9a1a77-b82f-463e-8b5a-cfcde6df17ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3d71a21a-bb5c-43ae-96cf-3b07dc1e8075 tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c9afbd4-3572-45fc-a0ea-45e832558c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3d71a21a-bb5c-43ae-96cf-3b07dc1e8075 tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c9afbd4-3572-45fc-a0ea-45e832558c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dac8202-4328-45da-be0b-4b2eb8ff364e', 'volume_name': 'volume-6dac8202-4328-45da-be0b-4b2eb8ff364e', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3d71a21a-bb5c-43ae-96cf-3b07dc1e8075 tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e95c2e7-25eb-40b3-a26c-75860beb4d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3d71a21a-bb5c-43ae-96cf-3b07dc1e8075 tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e95c2e7-25eb-40b3-a26c-75860beb4d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3d71a21a-bb5c-43ae-96cf-3b07dc1e8075 tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76800c90-21c8-4333-8ab2-1e49aba2f95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:52 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-3d71a21a-bb5c-43ae-96cf-3b07dc1e8075 tempest-CreateVolumesFromImageTest-694268940 None] Volume 6dac8202-4328-45da-be0b-4b2eb8ff364e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dac8202-4328-45da-be0b-4b2eb8ff364e', 'volume_size': 1}
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3d71a21a-bb5c-43ae-96cf-3b07dc1e8075 tempest-CreateVolumesFromImageTest-694268940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-63c27abd-60f5-4615-8b80-90372e9ac753 tempest-CreateVolumesFromImageTest-694268940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-63c27abd-60f5-4615-8b80-90372e9ac753 tempest-CreateVolumesFromImageTest-694268940 None] Flow 'volume_create_manager' (723c609f-d8a9-4709-8bb3-75d6e59d6119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-63c27abd-60f5-4615-8b80-90372e9ac753 tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83e30d49-955a-48d4-925c-3a65f802cee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-63c27abd-60f5-4615-8b80-90372e9ac753 tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83e30d49-955a-48d4-925c-3a65f802cee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-107758050',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87cb3643-6a5f-4e5b-b0b3-f3f864b8e8e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dcbf176efb44c48add6eac981a0c3b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:46:52Z,use_quota=True,user_id='bacc012d1f814f378f9617ad382932a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-63c27abd-60f5-4615-8b80-90372e9ac753 tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c02e293f-2f32-4793-9389-0fa9e37488b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-63c27abd-60f5-4615-8b80-90372e9ac753 tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c02e293f-2f32-4793-9389-0fa9e37488b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-63c27abd-60f5-4615-8b80-90372e9ac753 tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33636eed-d786-4ba6-9b92-c72ab1bd96ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-63c27abd-60f5-4615-8b80-90372e9ac753 tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33636eed-d786-4ba6-9b92-c72ab1bd96ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87cb3643-6a5f-4e5b-b0b3-f3f864b8e8e1', 'volume_name': 'volume-87cb3643-6a5f-4e5b-b0b3-f3f864b8e8e1', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-63c27abd-60f5-4615-8b80-90372e9ac753 tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e35e185-3cc4-4a69-a6a3-b239573ac662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-63c27abd-60f5-4615-8b80-90372e9ac753 tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e35e185-3cc4-4a69-a6a3-b239573ac662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-63c27abd-60f5-4615-8b80-90372e9ac753 tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d777887-11f8-4e1b-9369-5dcc286f95a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:46:52 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-63c27abd-60f5-4615-8b80-90372e9ac753 tempest-CreateVolumesFromImageTest-694268940 None] Volume 87cb3643-6a5f-4e5b-b0b3-f3f864b8e8e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87cb3643-6a5f-4e5b-b0b3-f3f864b8e8e1', 'volume_size': 1}
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-63c27abd-60f5-4615-8b80-90372e9ac753 tempest-CreateVolumesFromImageTest-694268940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:52 devstack sudo[89819]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85.73faaa4d-856b-4f41-9150-c04e6bc4b2b9 1G" returned: 0 in 0.635s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e04159a6-93ad-4f41-9fa5-6acfc113db85 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85.73faaa4d-856b-4f41-9150-c04e6bc4b2b9 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:52 devstack sudo[89824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e04159a6-93ad-4f41-9fa5-6acfc113db85 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85.73faaa4d-856b-4f41-9150-c04e6bc4b2b9
Feb 28 04:46:52 devstack sudo[89824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:53 devstack sudo[89824]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e04159a6-93ad-4f41-9fa5-6acfc113db85 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85.73faaa4d-856b-4f41-9150-c04e6bc4b2b9" returned: 0 in 0.493s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:53 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85.73faaa4d-856b-4f41-9150-c04e6bc4b2b9 is being set with open permissions: ugo+rw
Feb 28 04:46:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85.73faaa4d-856b-4f41-9150-c04e6bc4b2b9 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:53 devstack sudo[89829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85.73faaa4d-856b-4f41-9150-c04e6bc4b2b9
Feb 28 04:46:53 devstack sudo[89829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:53 devstack sudo[89829]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85.73faaa4d-856b-4f41-9150-c04e6bc4b2b9" returned: 0 in 0.448s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:53 devstack sudo[89832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85.info
Feb 28 04:46:53 devstack sudo[89832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:54 devstack sudo[89832]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85.info" returned: 0 in 0.435s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:54 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85.info is being set with open permissions: ugo+rw
Feb 28 04:46:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:54 devstack sudo[89835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85.info
Feb 28 04:46:54 devstack sudo[89835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:54 devstack sudo[89835]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85.info" returned: 0 in 0.436s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:54 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Acquiring lock "cinder-quobyte-9d69d36f-3bb0-4e34-adbe-6e01cc187521" by "_copy_volume_from_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:54 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Lock "cinder-quobyte-9d69d36f-3bb0-4e34-adbe-6e01cc187521" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:54 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] snapshot: 73faaa4d-856b-4f41-9150-c04e6bc4b2b9, volume: 9d69d36f-3bb0-4e34-adbe-6e01cc187521,  {{(pid=84248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 28 04:46:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:46:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:46:54 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:46:54 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:46:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:46:54 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d9f6a5-8d0e-45ad-b770-911cad0476b4]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85.73faaa4d-856b-4f41-9150-c04e6bc4b2b9 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:54 devstack sudo[89838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85.73faaa4d-856b-4f41-9150-c04e6bc4b2b9
Feb 28 04:46:54 devstack sudo[89838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:55 devstack sudo[89838]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85.73faaa4d-856b-4f41-9150-c04e6bc4b2b9" returned: 0 in 0.492s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:55 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e04159a6-93ad-4f41-9fa5-6acfc113db85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:46:55 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] will copy from snapshot at /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85 {{(pid=84248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 28 04:46:55 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Creating direct copy from snapshot {{(pid=84248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 28 04:46:55 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b3bd3b-a7d4-4270-bffb-939b8a7b39ec]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:55 devstack sudo[89843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85
Feb 28 04:46:55 devstack sudo[89843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:55 devstack sudo[89843]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85" returned: 0 in 0.519s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:55 devstack cinder-volume[84248]: DEBUG cinder.utils [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Path /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9d69d36f-3bb0-4e34-adbe-6e01cc187521 not found in is_blk_device check {{(pid=84248) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 28 04:46:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9d69d36f-3bb0-4e34-adbe-6e01cc187521 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:55 devstack sudo[89848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9d69d36f-3bb0-4e34-adbe-6e01cc187521
Feb 28 04:46:55 devstack sudo[89848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:57 devstack sudo[89848]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:57 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9d69d36f-3bb0-4e34-adbe-6e01cc187521" returned: 0 in 2.089s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:57 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[9725eb91-8484-4840-a8ce-a985733e5c55]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:57 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:57 devstack sudo[89860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85
Feb 28 04:46:57 devstack sudo[89860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:58 devstack sudo[89860]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:58 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85" returned: 0 in 0.609s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:58 devstack cinder-volume[84248]: DEBUG cinder.image.image_utils [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Image conversion details: src /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85, size 1024.00 MB, duration 2.09 sec, destination /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9d69d36f-3bb0-4e34-adbe-6e01cc187521 {{(pid=84248) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 28 04:46:58 devstack cinder-volume[84248]: INFO cinder.image.image_utils [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Converted 1024.00 MB image at 490.01 MB/s
Feb 28 04:46:58 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9d69d36f-3bb0-4e34-adbe-6e01cc187521 is being set with open permissions: ugo+rw
Feb 28 04:46:58 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9d69d36f-3bb0-4e34-adbe-6e01cc187521 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:58 devstack sudo[89865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9d69d36f-3bb0-4e34-adbe-6e01cc187521
Feb 28 04:46:58 devstack sudo[89865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:58 devstack sudo[89865]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:58 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9d69d36f-3bb0-4e34-adbe-6e01cc187521" returned: 0 in 0.403s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:58 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Lock "cinder-quobyte-9d69d36f-3bb0-4e34-adbe-6e01cc187521" released by "_copy_volume_from_snapshot" :: held 4.159s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:46:58 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Acquiring lock "cinder-quobyte-73faaa4d-856b-4f41-9150-c04e6bc4b2b9" by "_delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:46:58 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Lock "cinder-quobyte-73faaa4d-856b-4f41-9150-c04e6bc4b2b9" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:46:58 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Deleting offline snapshot 73faaa4d-856b-4f41-9150-c04e6bc4b2b9 of volume e04159a6-93ad-4f41-9fa5-6acfc113db85 {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 04:46:58 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] snapshot_file for this snap is: volume-e04159a6-93ad-4f41-9fa5-6acfc113db85.73faaa4d-856b-4f41-9150-c04e6bc4b2b9 {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 04:46:58 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[9629b807-f477-498b-94ec-705931b84179]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:58 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85.73faaa4d-856b-4f41-9150-c04e6bc4b2b9 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:58 devstack sudo[89868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85.73faaa4d-856b-4f41-9150-c04e6bc4b2b9
Feb 28 04:46:58 devstack sudo[89868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:59 devstack sudo[89868]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85.73faaa4d-856b-4f41-9150-c04e6bc4b2b9" returned: 0 in 0.514s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:59 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e04159a6-93ad-4f41-9fa5-6acfc113db85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:46:59 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[3087ce0f-cf44-40fc-a016-0ca173d54eaa]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:46:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:59 devstack sudo[89873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85
Feb 28 04:46:59 devstack sudo[89873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:46:59 devstack sudo[89873]: pam_unix(sudo:session): session closed for user root
Feb 28 04:46:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85" returned: 0 in 0.510s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:46:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85.73faaa4d-856b-4f41-9150-c04e6bc4b2b9 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:46:59 devstack sudo[89879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85.73faaa4d-856b-4f41-9150-c04e6bc4b2b9
Feb 28 04:46:59 devstack sudo[89879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:00 devstack sudo[89879]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85.73faaa4d-856b-4f41-9150-c04e6bc4b2b9" returned: 0 in 0.481s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85.73faaa4d-856b-4f41-9150-c04e6bc4b2b9 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:00 devstack sudo[89884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85.73faaa4d-856b-4f41-9150-c04e6bc4b2b9
Feb 28 04:47:00 devstack sudo[89884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:00 devstack sudo[89884]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85.73faaa4d-856b-4f41-9150-c04e6bc4b2b9" returned: 0 in 0.442s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:00 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Lock "cinder-quobyte-73faaa4d-856b-4f41-9150-c04e6bc4b2b9" released by "_delete_snapshot" :: held 2.003s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:47:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.367s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:47:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d4739a6b-b68b-4ff0-b667-af85d48c0a3d tempest-CreateVolumesFromImageTest-694268940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.997s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:47:00 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-d4739a6b-b68b-4ff0-b667-af85d48c0a3d tempest-CreateVolumesFromImageTest-694268940 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:46:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1863289710',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79dd7500-d311-4531-a23b-5947776112c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dcbf176efb44c48add6eac981a0c3b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:46:52Z,use_quota=True,user_id='bacc012d1f814f378f9617ad382932a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:47:00 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-d4739a6b-b68b-4ff0-b667-af85d48c0a3d tempest-CreateVolumesFromImageTest-694268940 None] Creating volume 79dd7500-d311-4531-a23b-5947776112c6 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:47:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d4739a6b-b68b-4ff0-b667-af85d48c0a3d tempest-CreateVolumesFromImageTest-694268940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:47:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d4739a6b-b68b-4ff0-b667-af85d48c0a3d tempest-CreateVolumesFromImageTest-694268940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:47:00 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-d4739a6b-b68b-4ff0-b667-af85d48c0a3d tempest-CreateVolumesFromImageTest-694268940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:47:00 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-d4739a6b-b68b-4ff0-b667-af85d48c0a3d tempest-CreateVolumesFromImageTest-694268940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:47:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d4739a6b-b68b-4ff0-b667-af85d48c0a3d tempest-CreateVolumesFromImageTest-694268940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:47:00 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-d4739a6b-b68b-4ff0-b667-af85d48c0a3d tempest-CreateVolumesFromImageTest-694268940 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:47:00 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-d4739a6b-b68b-4ff0-b667-af85d48c0a3d tempest-CreateVolumesFromImageTest-694268940 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:47:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d4739a6b-b68b-4ff0-b667-af85d48c0a3d tempest-CreateVolumesFromImageTest-694268940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-79dd7500-d311-4531-a23b-5947776112c6 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:00 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffe8f500-07bb-4912-8e55-c349583795c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d69d36f-3bb0-4e34-adbe-6e01cc187521', 'volume_size': 1, 'source_volid': 'e04159a6-93ad-4f41-9fa5-6acfc113db85', 'source_volstatus': 'available'}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:47:00 devstack sudo[89887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-79dd7500-d311-4531-a23b-5947776112c6 1073741824
Feb 28 04:47:00 devstack sudo[89887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:00 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d253b97e-4f2c-4df8-8b3b-ec5352d1f5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:47:00 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Volume volume-9d69d36f-3bb0-4e34-adbe-6e01cc187521 (9d69d36f-3bb0-4e34-adbe-6e01cc187521): created successfully
Feb 28 04:47:00 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d253b97e-4f2c-4df8-8b3b-ec5352d1f5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:47:00 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Flow 'volume_create_manager' (025b0379-d1ae-4caa-9646-53f71e7e8e48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:47:00 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-4ffecf31-3da6-4b04-aec3-6e70df4a6a14 tempest-VolumeDependencyTests-162807668 None] Created volume successfully.
Feb 28 04:47:01 devstack sudo[89887]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d4739a6b-b68b-4ff0-b667-af85d48c0a3d tempest-CreateVolumesFromImageTest-694268940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-79dd7500-d311-4531-a23b-5947776112c6 1073741824" returned: 0 in 0.518s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d4739a6b-b68b-4ff0-b667-af85d48c0a3d tempest-CreateVolumesFromImageTest-694268940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-79dd7500-d311-4531-a23b-5947776112c6 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:01 devstack sudo[89892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-79dd7500-d311-4531-a23b-5947776112c6
Feb 28 04:47:01 devstack sudo[89892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:01 devstack sudo[89892]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d4739a6b-b68b-4ff0-b667-af85d48c0a3d tempest-CreateVolumesFromImageTest-694268940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-79dd7500-d311-4531-a23b-5947776112c6" returned: 0 in 0.460s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:01 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-d4739a6b-b68b-4ff0-b667-af85d48c0a3d tempest-CreateVolumesFromImageTest-694268940 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:47:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d4739a6b-b68b-4ff0-b667-af85d48c0a3d tempest-CreateVolumesFromImageTest-694268940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:47:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-c8a14ae3-a967-41d7-a162-8fe241e05b37 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.937s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:47:01 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-c8a14ae3-a967-41d7-a162-8fe241e05b37 tempest-VolumesSnapshotTestJSON-1450209302 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1022067611',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f143321-1a8b-493c-ae41-d891b2af1525,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38e49879b3b24d2d9b0adf1476729ddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:46:52Z,use_quota=True,user_id='5ddc0b80823a4acc8f06430d30a63512',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:47:01 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-c8a14ae3-a967-41d7-a162-8fe241e05b37 tempest-VolumesSnapshotTestJSON-1450209302 None] Creating volume 7f143321-1a8b-493c-ae41-d891b2af1525 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:47:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-c8a14ae3-a967-41d7-a162-8fe241e05b37 tempest-VolumesSnapshotTestJSON-1450209302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:47:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-c8a14ae3-a967-41d7-a162-8fe241e05b37 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:47:01 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-c8a14ae3-a967-41d7-a162-8fe241e05b37 tempest-VolumesSnapshotTestJSON-1450209302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:47:01 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-c8a14ae3-a967-41d7-a162-8fe241e05b37 tempest-VolumesSnapshotTestJSON-1450209302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:47:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-c8a14ae3-a967-41d7-a162-8fe241e05b37 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:47:01 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-c8a14ae3-a967-41d7-a162-8fe241e05b37 tempest-VolumesSnapshotTestJSON-1450209302 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:47:01 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-c8a14ae3-a967-41d7-a162-8fe241e05b37 tempest-VolumesSnapshotTestJSON-1450209302 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:47:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-c8a14ae3-a967-41d7-a162-8fe241e05b37 tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d4739a6b-b68b-4ff0-b667-af85d48c0a3d tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6925d599-d100-4f5b-a487-d15947985d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79dd7500-d311-4531-a23b-5947776112c6', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:47:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d4739a6b-b68b-4ff0-b667-af85d48c0a3d tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ce5e34c-0a08-47be-827b-b9e733989c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:47:01 devstack sudo[89895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525 1073741824
Feb 28 04:47:01 devstack sudo[89895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:01 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-d4739a6b-b68b-4ff0-b667-af85d48c0a3d tempest-CreateVolumesFromImageTest-694268940 None] Volume volume-79dd7500-d311-4531-a23b-5947776112c6 (79dd7500-d311-4531-a23b-5947776112c6): created successfully
Feb 28 04:47:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d4739a6b-b68b-4ff0-b667-af85d48c0a3d tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ce5e34c-0a08-47be-827b-b9e733989c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:47:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d4739a6b-b68b-4ff0-b667-af85d48c0a3d tempest-CreateVolumesFromImageTest-694268940 None] Flow 'volume_create_manager' (7c47cbe8-16f7-4533-92f4-d6729528ba53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:47:01 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-d4739a6b-b68b-4ff0-b667-af85d48c0a3d tempest-CreateVolumesFromImageTest-694268940 None] Created volume successfully.
Feb 28 04:47:02 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-382baee9-6a91-495a-95f1-3a467e5434b2 tempest-VolumeDependencyTests-162807668 None] Acquiring lock "cinder-e04159a6-93ad-4f41-9fa5-6acfc113db85-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:47:02 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-382baee9-6a91-495a-95f1-3a467e5434b2 tempest-VolumeDependencyTests-162807668 None] Lock "cinder-e04159a6-93ad-4f41-9fa5-6acfc113db85-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:47:02 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-382baee9-6a91-495a-95f1-3a467e5434b2 tempest-VolumeDependencyTests-162807668 None] Acquiring lock "cinder-quobyte-e04159a6-93ad-4f41-9fa5-6acfc113db85" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:47:02 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-382baee9-6a91-495a-95f1-3a467e5434b2 tempest-VolumeDependencyTests-162807668 None] Lock "cinder-quobyte-e04159a6-93ad-4f41-9fa5-6acfc113db85" acquired by "delete_volume" :: waited 0.016s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:47:02 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd661631-8102-476a-9a14-99b5610fe576]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:47:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-382baee9-6a91-495a-95f1-3a467e5434b2 tempest-VolumeDependencyTests-162807668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:02 devstack sudo[89897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85
Feb 28 04:47:02 devstack sudo[89897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:02 devstack sudo[89895]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-c8a14ae3-a967-41d7-a162-8fe241e05b37 tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525 1073741824" returned: 0 in 0.556s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-c8a14ae3-a967-41d7-a162-8fe241e05b37 tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:02 devstack sudo[89902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525
Feb 28 04:47:02 devstack sudo[89902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:02 devstack sudo[89897]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-382baee9-6a91-495a-95f1-3a467e5434b2 tempest-VolumeDependencyTests-162807668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85" returned: 0 in 0.552s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-382baee9-6a91-495a-95f1-3a467e5434b2 tempest-VolumeDependencyTests-162807668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:02 devstack sudo[89907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85
Feb 28 04:47:02 devstack sudo[89907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:02 devstack sudo[89902]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-c8a14ae3-a967-41d7-a162-8fe241e05b37 tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525" returned: 0 in 0.483s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:02 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-c8a14ae3-a967-41d7-a162-8fe241e05b37 tempest-VolumesSnapshotTestJSON-1450209302 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:47:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-c8a14ae3-a967-41d7-a162-8fe241e05b37 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:47:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-0ec82c0d-37ed-4116-a59c-e60e1c3ccb1f tempest-CreateVolumesFromImageTest-694268940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.921s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:47:02 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-0ec82c0d-37ed-4116-a59c-e60e1c3ccb1f tempest-CreateVolumesFromImageTest-694268940 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2051045424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49d10e58-6ec2-4a61-bb73-e917f9685638,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dcbf176efb44c48add6eac981a0c3b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:46:52Z,use_quota=True,user_id='bacc012d1f814f378f9617ad382932a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:47:02 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-0ec82c0d-37ed-4116-a59c-e60e1c3ccb1f tempest-CreateVolumesFromImageTest-694268940 None] Creating volume 49d10e58-6ec2-4a61-bb73-e917f9685638 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:47:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-0ec82c0d-37ed-4116-a59c-e60e1c3ccb1f tempest-CreateVolumesFromImageTest-694268940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:47:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-0ec82c0d-37ed-4116-a59c-e60e1c3ccb1f tempest-CreateVolumesFromImageTest-694268940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:47:02 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-0ec82c0d-37ed-4116-a59c-e60e1c3ccb1f tempest-CreateVolumesFromImageTest-694268940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:47:02 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-0ec82c0d-37ed-4116-a59c-e60e1c3ccb1f tempest-CreateVolumesFromImageTest-694268940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:47:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-0ec82c0d-37ed-4116-a59c-e60e1c3ccb1f tempest-CreateVolumesFromImageTest-694268940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:47:02 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-0ec82c0d-37ed-4116-a59c-e60e1c3ccb1f tempest-CreateVolumesFromImageTest-694268940 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:47:02 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-0ec82c0d-37ed-4116-a59c-e60e1c3ccb1f tempest-CreateVolumesFromImageTest-694268940 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:47:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-0ec82c0d-37ed-4116-a59c-e60e1c3ccb1f tempest-CreateVolumesFromImageTest-694268940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-49d10e58-6ec2-4a61-bb73-e917f9685638 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:02 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-c8a14ae3-a967-41d7-a162-8fe241e05b37 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee365791-d09d-4e12-b5f7-3e15a3490733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f143321-1a8b-493c-ae41-d891b2af1525', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:47:02 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-c8a14ae3-a967-41d7-a162-8fe241e05b37 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8353997-f862-4858-af7d-82ee19f88426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:47:02 devstack sudo[89910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-49d10e58-6ec2-4a61-bb73-e917f9685638 1073741824
Feb 28 04:47:02 devstack sudo[89910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:02 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-c8a14ae3-a967-41d7-a162-8fe241e05b37 tempest-VolumesSnapshotTestJSON-1450209302 None] Volume volume-7f143321-1a8b-493c-ae41-d891b2af1525 (7f143321-1a8b-493c-ae41-d891b2af1525): created successfully
Feb 28 04:47:02 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-c8a14ae3-a967-41d7-a162-8fe241e05b37 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8353997-f862-4858-af7d-82ee19f88426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:47:02 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-c8a14ae3-a967-41d7-a162-8fe241e05b37 tempest-VolumesSnapshotTestJSON-1450209302 None] Flow 'volume_create_manager' (ce46e180-0960-4ed2-9a76-9d93371e818d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:47:02 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-c8a14ae3-a967-41d7-a162-8fe241e05b37 tempest-VolumesSnapshotTestJSON-1450209302 None] Created volume successfully.
Feb 28 04:47:03 devstack sudo[89907]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-382baee9-6a91-495a-95f1-3a467e5434b2 tempest-VolumeDependencyTests-162807668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e04159a6-93ad-4f41-9fa5-6acfc113db85" returned: 0 in 0.535s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:03 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-382baee9-6a91-495a-95f1-3a467e5434b2 tempest-VolumeDependencyTests-162807668 None] Lock "cinder-quobyte-e04159a6-93ad-4f41-9fa5-6acfc113db85" released by "delete_volume" :: held 1.133s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:47:03 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-382baee9-6a91-495a-95f1-3a467e5434b2 tempest-VolumeDependencyTests-162807668 None] Created reservations ['79259e5d-4052-48bd-aa11-9b8d7e5bad6f', '54e57782-8019-40bd-9ba8-0641b4e44a4c', 'f981dfbb-f230-49c3-bfe4-15fe2fb637f5', 'e1d227d1-df3d-442d-969e-e1afca7b90b0'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:47:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-382baee9-6a91-495a-95f1-3a467e5434b2 tempest-VolumeDependencyTests-162807668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:47:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-382baee9-6a91-495a-95f1-3a467e5434b2 tempest-VolumeDependencyTests-162807668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:47:03 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-382baee9-6a91-495a-95f1-3a467e5434b2 tempest-VolumeDependencyTests-162807668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:47:03 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-382baee9-6a91-495a-95f1-3a467e5434b2 tempest-VolumeDependencyTests-162807668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:47:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-382baee9-6a91-495a-95f1-3a467e5434b2 tempest-VolumeDependencyTests-162807668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:47:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-382baee9-6a91-495a-95f1-3a467e5434b2 tempest-VolumeDependencyTests-162807668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:03 devstack sudo[89915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:47:03 devstack sudo[89915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3457573a-768a-4e86-8dcd-1e4b81e484ea tempest-VolumesSnapshotTestJSON-1450209302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:47:03 devstack sudo[89910]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-0ec82c0d-37ed-4116-a59c-e60e1c3ccb1f tempest-CreateVolumesFromImageTest-694268940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-49d10e58-6ec2-4a61-bb73-e917f9685638 1073741824" returned: 0 in 0.625s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-0ec82c0d-37ed-4116-a59c-e60e1c3ccb1f tempest-CreateVolumesFromImageTest-694268940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-49d10e58-6ec2-4a61-bb73-e917f9685638 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:03 devstack sudo[89918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-49d10e58-6ec2-4a61-bb73-e917f9685638
Feb 28 04:47:03 devstack sudo[89918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:03 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1f57e5f-e191-49ce-a728-1ccf40c21a46 tempest-VolumesActionsTest-1301683667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:47:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a1f57e5f-e191-49ce-a728-1ccf40c21a46 tempest-VolumesActionsTest-1301683667 None] Flow 'volume_create_manager' (30025e54-1ca4-4e30-b159-09a38000f786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:47:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a1f57e5f-e191-49ce-a728-1ccf40c21a46 tempest-VolumesActionsTest-1301683667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd8bcf60-e450-4fc4-aa3c-af53684597df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:47:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a1f57e5f-e191-49ce-a728-1ccf40c21a46 tempest-VolumesActionsTest-1301683667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd8bcf60-e450-4fc4-aa3c-af53684597df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1945759942',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59564c3e-78f0-4937-97da-b5b00dd152fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7023634f56d4cbcac45204e8f63ed6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:47:04Z,use_quota=True,user_id='ee4ac0e21875401f96cfea20582ff403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:47:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a1f57e5f-e191-49ce-a728-1ccf40c21a46 tempest-VolumesActionsTest-1301683667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18cdc688-171a-452e-9005-0221514981e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:47:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a1f57e5f-e191-49ce-a728-1ccf40c21a46 tempest-VolumesActionsTest-1301683667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18cdc688-171a-452e-9005-0221514981e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:47:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a1f57e5f-e191-49ce-a728-1ccf40c21a46 tempest-VolumesActionsTest-1301683667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f8f2f68-92c6-4701-90eb-9beb8ec952eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:47:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a1f57e5f-e191-49ce-a728-1ccf40c21a46 tempest-VolumesActionsTest-1301683667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f8f2f68-92c6-4701-90eb-9beb8ec952eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59564c3e-78f0-4937-97da-b5b00dd152fa', 'volume_name': 'volume-59564c3e-78f0-4937-97da-b5b00dd152fa', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:47:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a1f57e5f-e191-49ce-a728-1ccf40c21a46 tempest-VolumesActionsTest-1301683667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (161758c5-1707-44a7-8bc0-aa6036707b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:47:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a1f57e5f-e191-49ce-a728-1ccf40c21a46 tempest-VolumesActionsTest-1301683667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (161758c5-1707-44a7-8bc0-aa6036707b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:47:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a1f57e5f-e191-49ce-a728-1ccf40c21a46 tempest-VolumesActionsTest-1301683667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (010c152c-1e9c-45b9-bf86-db83dfaa4769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:47:03 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-a1f57e5f-e191-49ce-a728-1ccf40c21a46 tempest-VolumesActionsTest-1301683667 None] Volume 59564c3e-78f0-4937-97da-b5b00dd152fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59564c3e-78f0-4937-97da-b5b00dd152fa', 'volume_size': 1}
Feb 28 04:47:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a1f57e5f-e191-49ce-a728-1ccf40c21a46 tempest-VolumesActionsTest-1301683667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:47:03 devstack sudo[89915]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-382baee9-6a91-495a-95f1-3a467e5434b2 tempest-VolumeDependencyTests-162807668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.474s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:03 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-382baee9-6a91-495a-95f1-3a467e5434b2 tempest-VolumeDependencyTests-162807668 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:47:03 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-382baee9-6a91-495a-95f1-3a467e5434b2 tempest-VolumeDependencyTests-162807668 None] Deleted volume successfully.
Feb 28 04:47:03 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-382baee9-6a91-495a-95f1-3a467e5434b2 tempest-VolumeDependencyTests-162807668 None] Lock "cinder-e04159a6-93ad-4f41-9fa5-6acfc113db85-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:47:04 devstack sudo[89918]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-0ec82c0d-37ed-4116-a59c-e60e1c3ccb1f tempest-CreateVolumesFromImageTest-694268940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-49d10e58-6ec2-4a61-bb73-e917f9685638" returned: 0 in 0.424s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:04 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-0ec82c0d-37ed-4116-a59c-e60e1c3ccb1f tempest-CreateVolumesFromImageTest-694268940 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:47:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-0ec82c0d-37ed-4116-a59c-e60e1c3ccb1f tempest-CreateVolumesFromImageTest-694268940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:47:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-2256a282-5de1-499b-b9cb-11124d57c60e tempest-CreateVolumesFromImageTest-694268940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.885s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:47:04 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-2256a282-5de1-499b-b9cb-11124d57c60e tempest-CreateVolumesFromImageTest-694268940 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1908740673',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44312f19-0476-4652-9b51-d19a60cd57ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dcbf176efb44c48add6eac981a0c3b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:46:52Z,use_quota=True,user_id='bacc012d1f814f378f9617ad382932a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:47:04 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-2256a282-5de1-499b-b9cb-11124d57c60e tempest-CreateVolumesFromImageTest-694268940 None] Creating volume 44312f19-0476-4652-9b51-d19a60cd57ce {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:47:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-2256a282-5de1-499b-b9cb-11124d57c60e tempest-CreateVolumesFromImageTest-694268940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:47:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-2256a282-5de1-499b-b9cb-11124d57c60e tempest-CreateVolumesFromImageTest-694268940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:47:04 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-2256a282-5de1-499b-b9cb-11124d57c60e tempest-CreateVolumesFromImageTest-694268940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:47:04 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-2256a282-5de1-499b-b9cb-11124d57c60e tempest-CreateVolumesFromImageTest-694268940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:47:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-2256a282-5de1-499b-b9cb-11124d57c60e tempest-CreateVolumesFromImageTest-694268940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:47:04 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-2256a282-5de1-499b-b9cb-11124d57c60e tempest-CreateVolumesFromImageTest-694268940 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:47:04 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-2256a282-5de1-499b-b9cb-11124d57c60e tempest-CreateVolumesFromImageTest-694268940 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:47:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-2256a282-5de1-499b-b9cb-11124d57c60e tempest-CreateVolumesFromImageTest-694268940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-44312f19-0476-4652-9b51-d19a60cd57ce 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-0ec82c0d-37ed-4116-a59c-e60e1c3ccb1f tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1177758b-7621-4840-884f-5212a0a0996d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49d10e58-6ec2-4a61-bb73-e917f9685638', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:47:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-0ec82c0d-37ed-4116-a59c-e60e1c3ccb1f tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ff7fc2-6ac6-4b55-9ebe-8c1e9c808e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:47:04 devstack sudo[89922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-44312f19-0476-4652-9b51-d19a60cd57ce 1073741824
Feb 28 04:47:04 devstack sudo[89922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:04 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-0ec82c0d-37ed-4116-a59c-e60e1c3ccb1f tempest-CreateVolumesFromImageTest-694268940 None] Volume volume-49d10e58-6ec2-4a61-bb73-e917f9685638 (49d10e58-6ec2-4a61-bb73-e917f9685638): created successfully
Feb 28 04:47:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-0ec82c0d-37ed-4116-a59c-e60e1c3ccb1f tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ff7fc2-6ac6-4b55-9ebe-8c1e9c808e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:47:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-0ec82c0d-37ed-4116-a59c-e60e1c3ccb1f tempest-CreateVolumesFromImageTest-694268940 None] Flow 'volume_create_manager' (3f9333dd-3f76-46eb-b04e-43a427fc528c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:47:04 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-0ec82c0d-37ed-4116-a59c-e60e1c3ccb1f tempest-CreateVolumesFromImageTest-694268940 None] Created volume successfully.
Feb 28 04:47:04 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-bef3f3c5-6143-48bd-bcd3-d121f534e81d tempest-VolumeDependencyTests-162807668 None] Acquiring lock "cinder-9d69d36f-3bb0-4e34-adbe-6e01cc187521-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:47:04 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-bef3f3c5-6143-48bd-bcd3-d121f534e81d tempest-VolumeDependencyTests-162807668 None] Lock "cinder-9d69d36f-3bb0-4e34-adbe-6e01cc187521-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:47:04 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-bef3f3c5-6143-48bd-bcd3-d121f534e81d tempest-VolumeDependencyTests-162807668 None] Acquiring lock "cinder-quobyte-9d69d36f-3bb0-4e34-adbe-6e01cc187521" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:47:04 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-bef3f3c5-6143-48bd-bcd3-d121f534e81d tempest-VolumeDependencyTests-162807668 None] Lock "cinder-quobyte-9d69d36f-3bb0-4e34-adbe-6e01cc187521" acquired by "delete_volume" :: waited 0.008s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:47:04 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70522f8-7a96-4f74-88e7-c369e0a1ece3]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:47:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-bef3f3c5-6143-48bd-bcd3-d121f534e81d tempest-VolumeDependencyTests-162807668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9d69d36f-3bb0-4e34-adbe-6e01cc187521 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:04 devstack sudo[89925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9d69d36f-3bb0-4e34-adbe-6e01cc187521
Feb 28 04:47:04 devstack sudo[89925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:04 devstack sudo[89922]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-2256a282-5de1-499b-b9cb-11124d57c60e tempest-CreateVolumesFromImageTest-694268940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-44312f19-0476-4652-9b51-d19a60cd57ce 1073741824" returned: 0 in 0.510s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-2256a282-5de1-499b-b9cb-11124d57c60e tempest-CreateVolumesFromImageTest-694268940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-44312f19-0476-4652-9b51-d19a60cd57ce {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:04 devstack sudo[89929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-44312f19-0476-4652-9b51-d19a60cd57ce
Feb 28 04:47:04 devstack sudo[89929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:04 devstack sudo[89925]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-bef3f3c5-6143-48bd-bcd3-d121f534e81d tempest-VolumeDependencyTests-162807668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9d69d36f-3bb0-4e34-adbe-6e01cc187521" returned: 0 in 0.468s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-bef3f3c5-6143-48bd-bcd3-d121f534e81d tempest-VolumeDependencyTests-162807668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9d69d36f-3bb0-4e34-adbe-6e01cc187521 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:04 devstack sudo[89934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9d69d36f-3bb0-4e34-adbe-6e01cc187521
Feb 28 04:47:04 devstack sudo[89934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:04 devstack sudo[89929]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-2256a282-5de1-499b-b9cb-11124d57c60e tempest-CreateVolumesFromImageTest-694268940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-44312f19-0476-4652-9b51-d19a60cd57ce" returned: 0 in 0.407s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:04 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-2256a282-5de1-499b-b9cb-11124d57c60e tempest-CreateVolumesFromImageTest-694268940 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:47:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-2256a282-5de1-499b-b9cb-11124d57c60e tempest-CreateVolumesFromImageTest-694268940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:47:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3d71a21a-bb5c-43ae-96cf-3b07dc1e8075 tempest-CreateVolumesFromImageTest-694268940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.633s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:47:04 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-3d71a21a-bb5c-43ae-96cf-3b07dc1e8075 tempest-CreateVolumesFromImageTest-694268940 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1975093443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dac8202-4328-45da-be0b-4b2eb8ff364e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dcbf176efb44c48add6eac981a0c3b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:46:52Z,use_quota=True,user_id='bacc012d1f814f378f9617ad382932a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:47:04 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-3d71a21a-bb5c-43ae-96cf-3b07dc1e8075 tempest-CreateVolumesFromImageTest-694268940 None] Creating volume 6dac8202-4328-45da-be0b-4b2eb8ff364e {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:47:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3d71a21a-bb5c-43ae-96cf-3b07dc1e8075 tempest-CreateVolumesFromImageTest-694268940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:47:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3d71a21a-bb5c-43ae-96cf-3b07dc1e8075 tempest-CreateVolumesFromImageTest-694268940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:47:04 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-3d71a21a-bb5c-43ae-96cf-3b07dc1e8075 tempest-CreateVolumesFromImageTest-694268940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:47:04 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-3d71a21a-bb5c-43ae-96cf-3b07dc1e8075 tempest-CreateVolumesFromImageTest-694268940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:47:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3d71a21a-bb5c-43ae-96cf-3b07dc1e8075 tempest-CreateVolumesFromImageTest-694268940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:47:04 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-3d71a21a-bb5c-43ae-96cf-3b07dc1e8075 tempest-CreateVolumesFromImageTest-694268940 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:47:04 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-3d71a21a-bb5c-43ae-96cf-3b07dc1e8075 tempest-CreateVolumesFromImageTest-694268940 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:47:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3d71a21a-bb5c-43ae-96cf-3b07dc1e8075 tempest-CreateVolumesFromImageTest-694268940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6dac8202-4328-45da-be0b-4b2eb8ff364e 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-2256a282-5de1-499b-b9cb-11124d57c60e tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ad5382e-79e1-42b9-962e-d767a2d617f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44312f19-0476-4652-9b51-d19a60cd57ce', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:47:04 devstack sudo[89937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6dac8202-4328-45da-be0b-4b2eb8ff364e 1073741824
Feb 28 04:47:04 devstack sudo[89937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-2256a282-5de1-499b-b9cb-11124d57c60e tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed3b32fe-3f86-4be1-bb07-544ffb8871d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:47:05 devstack cinder-volume[84248]: DEBUG dbcounter [-] [84248] Writing DB stats cinder:UPDATE=265,cinder:DELETE=23,cinder:SELECT=199,cinder:INSERT=52 {{(pid=84248) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 04:47:05 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-2256a282-5de1-499b-b9cb-11124d57c60e tempest-CreateVolumesFromImageTest-694268940 None] Volume volume-44312f19-0476-4652-9b51-d19a60cd57ce (44312f19-0476-4652-9b51-d19a60cd57ce): created successfully
Feb 28 04:47:05 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-2256a282-5de1-499b-b9cb-11124d57c60e tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed3b32fe-3f86-4be1-bb07-544ffb8871d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:47:05 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-2256a282-5de1-499b-b9cb-11124d57c60e tempest-CreateVolumesFromImageTest-694268940 None] Flow 'volume_create_manager' (49f01de8-c3b4-41bd-bc92-d232807da832) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:47:05 devstack cinder-volume[84248]: DEBUG dbcounter [-] [84248] Writing DB stats cinder:SELECT=217,cinder:UPDATE=221,cinder:INSERT=75,cinder:DELETE=16 {{(pid=84248) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 04:47:05 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-2256a282-5de1-499b-b9cb-11124d57c60e tempest-CreateVolumesFromImageTest-694268940 None] Created volume successfully.
Feb 28 04:47:05 devstack sudo[89934]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-bef3f3c5-6143-48bd-bcd3-d121f534e81d tempest-VolumeDependencyTests-162807668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9d69d36f-3bb0-4e34-adbe-6e01cc187521" returned: 0 in 0.407s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:05 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-bef3f3c5-6143-48bd-bcd3-d121f534e81d tempest-VolumeDependencyTests-162807668 None] Lock "cinder-quobyte-9d69d36f-3bb0-4e34-adbe-6e01cc187521" released by "delete_volume" :: held 0.907s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:47:05 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-bef3f3c5-6143-48bd-bcd3-d121f534e81d tempest-VolumeDependencyTests-162807668 None] Created reservations ['ae75b9e0-e0a3-43d5-8d29-f23860e1cb8d', 'ceaba6a0-b7e5-4705-b489-bde54a5c063c', '7cc0c60f-dec7-4f8c-83de-96f24b0a7a93', 'f2e68b9e-155f-4f5c-9303-1761505daf54'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:47:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-bef3f3c5-6143-48bd-bcd3-d121f534e81d tempest-VolumeDependencyTests-162807668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:47:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-bef3f3c5-6143-48bd-bcd3-d121f534e81d tempest-VolumeDependencyTests-162807668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:47:05 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-bef3f3c5-6143-48bd-bcd3-d121f534e81d tempest-VolumeDependencyTests-162807668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:47:05 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-bef3f3c5-6143-48bd-bcd3-d121f534e81d tempest-VolumeDependencyTests-162807668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:47:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-bef3f3c5-6143-48bd-bcd3-d121f534e81d tempest-VolumeDependencyTests-162807668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:47:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-bef3f3c5-6143-48bd-bcd3-d121f534e81d tempest-VolumeDependencyTests-162807668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:05 devstack sudo[89943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:47:05 devstack sudo[89943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:05 devstack sudo[89937]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3d71a21a-bb5c-43ae-96cf-3b07dc1e8075 tempest-CreateVolumesFromImageTest-694268940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6dac8202-4328-45da-be0b-4b2eb8ff364e 1073741824" returned: 0 in 0.494s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3d71a21a-bb5c-43ae-96cf-3b07dc1e8075 tempest-CreateVolumesFromImageTest-694268940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6dac8202-4328-45da-be0b-4b2eb8ff364e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:05 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ddf26bd4-40a3-47dd-a345-b89650580348 tempest-VolumeDependencyTests-162807668 None] Acquiring lock "cinder-08e995cf-e5b7-4d72-b117-dae91ad23ecf-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:47:05 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ddf26bd4-40a3-47dd-a345-b89650580348 tempest-VolumeDependencyTests-162807668 None] Lock "cinder-08e995cf-e5b7-4d72-b117-dae91ad23ecf-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:47:05 devstack sudo[89945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6dac8202-4328-45da-be0b-4b2eb8ff364e
Feb 28 04:47:05 devstack sudo[89945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:05 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ddf26bd4-40a3-47dd-a345-b89650580348 tempest-VolumeDependencyTests-162807668 None] Acquiring lock "cinder-quobyte-08e995cf-e5b7-4d72-b117-dae91ad23ecf" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:47:05 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ddf26bd4-40a3-47dd-a345-b89650580348 tempest-VolumeDependencyTests-162807668 None] Lock "cinder-quobyte-08e995cf-e5b7-4d72-b117-dae91ad23ecf" acquired by "delete_volume" :: waited 0.009s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:47:05 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[e862b153-6852-4054-bb97-e3c42f15461c]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:47:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ddf26bd4-40a3-47dd-a345-b89650580348 tempest-VolumeDependencyTests-162807668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-08e995cf-e5b7-4d72-b117-dae91ad23ecf {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:05 devstack sudo[89947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-08e995cf-e5b7-4d72-b117-dae91ad23ecf
Feb 28 04:47:05 devstack sudo[89947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:05 devstack sudo[89943]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-bef3f3c5-6143-48bd-bcd3-d121f534e81d tempest-VolumeDependencyTests-162807668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.449s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:05 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-bef3f3c5-6143-48bd-bcd3-d121f534e81d tempest-VolumeDependencyTests-162807668 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:47:05 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-bef3f3c5-6143-48bd-bcd3-d121f534e81d tempest-VolumeDependencyTests-162807668 None] Deleted volume successfully.
Feb 28 04:47:05 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-bef3f3c5-6143-48bd-bcd3-d121f534e81d tempest-VolumeDependencyTests-162807668 None] Lock "cinder-9d69d36f-3bb0-4e34-adbe-6e01cc187521-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:47:05 devstack sudo[89945]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3d71a21a-bb5c-43ae-96cf-3b07dc1e8075 tempest-CreateVolumesFromImageTest-694268940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6dac8202-4328-45da-be0b-4b2eb8ff364e" returned: 0 in 0.420s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:05 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-3d71a21a-bb5c-43ae-96cf-3b07dc1e8075 tempest-CreateVolumesFromImageTest-694268940 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:47:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3d71a21a-bb5c-43ae-96cf-3b07dc1e8075 tempest-CreateVolumesFromImageTest-694268940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:47:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-63c27abd-60f5-4615-8b80-90372e9ac753 tempest-CreateVolumesFromImageTest-694268940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.357s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:47:05 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-63c27abd-60f5-4615-8b80-90372e9ac753 tempest-CreateVolumesFromImageTest-694268940 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-107758050',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87cb3643-6a5f-4e5b-b0b3-f3f864b8e8e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dcbf176efb44c48add6eac981a0c3b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:46:52Z,use_quota=True,user_id='bacc012d1f814f378f9617ad382932a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:47:05 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-63c27abd-60f5-4615-8b80-90372e9ac753 tempest-CreateVolumesFromImageTest-694268940 None] Creating volume 87cb3643-6a5f-4e5b-b0b3-f3f864b8e8e1 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:47:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-63c27abd-60f5-4615-8b80-90372e9ac753 tempest-CreateVolumesFromImageTest-694268940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:47:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-63c27abd-60f5-4615-8b80-90372e9ac753 tempest-CreateVolumesFromImageTest-694268940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:47:05 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-63c27abd-60f5-4615-8b80-90372e9ac753 tempest-CreateVolumesFromImageTest-694268940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:47:05 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-63c27abd-60f5-4615-8b80-90372e9ac753 tempest-CreateVolumesFromImageTest-694268940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:47:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-63c27abd-60f5-4615-8b80-90372e9ac753 tempest-CreateVolumesFromImageTest-694268940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:47:05 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-63c27abd-60f5-4615-8b80-90372e9ac753 tempest-CreateVolumesFromImageTest-694268940 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:47:05 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-63c27abd-60f5-4615-8b80-90372e9ac753 tempest-CreateVolumesFromImageTest-694268940 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:47:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-63c27abd-60f5-4615-8b80-90372e9ac753 tempest-CreateVolumesFromImageTest-694268940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-87cb3643-6a5f-4e5b-b0b3-f3f864b8e8e1 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:05 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3d71a21a-bb5c-43ae-96cf-3b07dc1e8075 tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76800c90-21c8-4333-8ab2-1e49aba2f95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dac8202-4328-45da-be0b-4b2eb8ff364e', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:47:05 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3d71a21a-bb5c-43ae-96cf-3b07dc1e8075 tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae69bc35-a07c-4934-9b3d-aa364fb9e89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:47:05 devstack sudo[89951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-87cb3643-6a5f-4e5b-b0b3-f3f864b8e8e1 1073741824
Feb 28 04:47:05 devstack sudo[89951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:05 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-3d71a21a-bb5c-43ae-96cf-3b07dc1e8075 tempest-CreateVolumesFromImageTest-694268940 None] Volume volume-6dac8202-4328-45da-be0b-4b2eb8ff364e (6dac8202-4328-45da-be0b-4b2eb8ff364e): created successfully
Feb 28 04:47:05 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3d71a21a-bb5c-43ae-96cf-3b07dc1e8075 tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae69bc35-a07c-4934-9b3d-aa364fb9e89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:47:05 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3d71a21a-bb5c-43ae-96cf-3b07dc1e8075 tempest-CreateVolumesFromImageTest-694268940 None] Flow 'volume_create_manager' (ad26f77a-64bf-4921-aaac-f8d62c155934) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:47:05 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-3d71a21a-bb5c-43ae-96cf-3b07dc1e8075 tempest-CreateVolumesFromImageTest-694268940 None] Created volume successfully.
Feb 28 04:47:06 devstack sudo[89947]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ddf26bd4-40a3-47dd-a345-b89650580348 tempest-VolumeDependencyTests-162807668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-08e995cf-e5b7-4d72-b117-dae91ad23ecf" returned: 0 in 0.524s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ddf26bd4-40a3-47dd-a345-b89650580348 tempest-VolumeDependencyTests-162807668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-08e995cf-e5b7-4d72-b117-dae91ad23ecf {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:06 devstack sudo[89956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-08e995cf-e5b7-4d72-b117-dae91ad23ecf
Feb 28 04:47:06 devstack sudo[89956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:06 devstack sudo[89951]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-63c27abd-60f5-4615-8b80-90372e9ac753 tempest-CreateVolumesFromImageTest-694268940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-87cb3643-6a5f-4e5b-b0b3-f3f864b8e8e1 1073741824" returned: 0 in 0.464s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-63c27abd-60f5-4615-8b80-90372e9ac753 tempest-CreateVolumesFromImageTest-694268940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-87cb3643-6a5f-4e5b-b0b3-f3f864b8e8e1 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:06 devstack sudo[89961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-87cb3643-6a5f-4e5b-b0b3-f3f864b8e8e1
Feb 28 04:47:06 devstack sudo[89961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:06 devstack sudo[89956]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ddf26bd4-40a3-47dd-a345-b89650580348 tempest-VolumeDependencyTests-162807668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-08e995cf-e5b7-4d72-b117-dae91ad23ecf" returned: 0 in 0.425s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:06 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ddf26bd4-40a3-47dd-a345-b89650580348 tempest-VolumeDependencyTests-162807668 None] Lock "cinder-quobyte-08e995cf-e5b7-4d72-b117-dae91ad23ecf" released by "delete_volume" :: held 0.973s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:47:06 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-ddf26bd4-40a3-47dd-a345-b89650580348 tempest-VolumeDependencyTests-162807668 None] Created reservations ['8bee8ac8-715b-4b7d-87ed-ad41e803d3b4', 'dff73c97-2d13-42f9-8a8e-7f41456dbc6a', 'eef27e26-a9a3-426f-ae8b-ab73f466ba4d', 'b222c418-a79d-4f93-ab79-ac9151bf0621'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:47:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ddf26bd4-40a3-47dd-a345-b89650580348 tempest-VolumeDependencyTests-162807668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:47:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ddf26bd4-40a3-47dd-a345-b89650580348 tempest-VolumeDependencyTests-162807668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:47:06 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-ddf26bd4-40a3-47dd-a345-b89650580348 tempest-VolumeDependencyTests-162807668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:47:06 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-ddf26bd4-40a3-47dd-a345-b89650580348 tempest-VolumeDependencyTests-162807668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:47:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ddf26bd4-40a3-47dd-a345-b89650580348 tempest-VolumeDependencyTests-162807668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:47:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ddf26bd4-40a3-47dd-a345-b89650580348 tempest-VolumeDependencyTests-162807668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:06 devstack sudo[89964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:47:06 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:06 devstack sudo[89961]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-63c27abd-60f5-4615-8b80-90372e9ac753 tempest-CreateVolumesFromImageTest-694268940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-87cb3643-6a5f-4e5b-b0b3-f3f864b8e8e1" returned: 0 in 0.434s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:06 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-63c27abd-60f5-4615-8b80-90372e9ac753 tempest-CreateVolumesFromImageTest-694268940 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:47:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-63c27abd-60f5-4615-8b80-90372e9ac753 tempest-CreateVolumesFromImageTest-694268940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:47:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3457573a-768a-4e86-8dcd-1e4b81e484ea tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.361s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:47:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-63c27abd-60f5-4615-8b80-90372e9ac753 tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d777887-11f8-4e1b-9369-5dcc286f95a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87cb3643-6a5f-4e5b-b0b3-f3f864b8e8e1', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:47:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-63c27abd-60f5-4615-8b80-90372e9ac753 tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (546bae36-31ec-4116-b52c-e48628c18c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:47:06 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-3457573a-768a-4e86-8dcd-1e4b81e484ea tempest-VolumesSnapshotTestJSON-1450209302 None] Creating offline snapshot 2b132118-4686-4c16-87a5-1da0b093f9e7 of volume 7f143321-1a8b-493c-ae41-d891b2af1525 {{(pid=84248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 04:47:06 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-63c27abd-60f5-4615-8b80-90372e9ac753 tempest-CreateVolumesFromImageTest-694268940 None] Volume volume-87cb3643-6a5f-4e5b-b0b3-f3f864b8e8e1 (87cb3643-6a5f-4e5b-b0b3-f3f864b8e8e1): created successfully
Feb 28 04:47:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-63c27abd-60f5-4615-8b80-90372e9ac753 tempest-CreateVolumesFromImageTest-694268940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (546bae36-31ec-4116-b52c-e48628c18c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:47:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-63c27abd-60f5-4615-8b80-90372e9ac753 tempest-CreateVolumesFromImageTest-694268940 None] Flow 'volume_create_manager' (723c609f-d8a9-4709-8bb3-75d6e59d6119) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:47:06 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b5e720-1835-40cc-8f0a-07737ff8d3a9]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:47:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3457573a-768a-4e86-8dcd-1e4b81e484ea tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:06 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-63c27abd-60f5-4615-8b80-90372e9ac753 tempest-CreateVolumesFromImageTest-694268940 None] Created volume successfully.
Feb 28 04:47:06 devstack sudo[89967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525
Feb 28 04:47:06 devstack sudo[89967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:07 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ddf26bd4-40a3-47dd-a345-b89650580348 tempest-VolumeDependencyTests-162807668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.418s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:07 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-ddf26bd4-40a3-47dd-a345-b89650580348 tempest-VolumeDependencyTests-162807668 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:47:07 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-ddf26bd4-40a3-47dd-a345-b89650580348 tempest-VolumeDependencyTests-162807668 None] Deleted volume successfully.
Feb 28 04:47:07 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ddf26bd4-40a3-47dd-a345-b89650580348 tempest-VolumeDependencyTests-162807668 None] Lock "cinder-08e995cf-e5b7-4d72-b117-dae91ad23ecf-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:47:07 devstack sudo[89967]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3457573a-768a-4e86-8dcd-1e4b81e484ea tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525" returned: 0 in 0.471s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3457573a-768a-4e86-8dcd-1e4b81e484ea tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525.2b132118-4686-4c16-87a5-1da0b093f9e7 1G {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:07 devstack sudo[89973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525.2b132118-4686-4c16-87a5-1da0b093f9e7 1G
Feb 28 04:47:07 devstack sudo[89973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:07 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-5fd2d109-1b77-42d6-b540-8cbb8012dfde tempest-CreateVolumesFromImageTest-694268940 None] Acquiring lock "cinder-87cb3643-6a5f-4e5b-b0b3-f3f864b8e8e1-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:47:07 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-5fd2d109-1b77-42d6-b540-8cbb8012dfde tempest-CreateVolumesFromImageTest-694268940 None] Lock "cinder-87cb3643-6a5f-4e5b-b0b3-f3f864b8e8e1-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:47:07 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-5fd2d109-1b77-42d6-b540-8cbb8012dfde tempest-CreateVolumesFromImageTest-694268940 None] Acquiring lock "cinder-quobyte-87cb3643-6a5f-4e5b-b0b3-f3f864b8e8e1" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:47:07 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-5fd2d109-1b77-42d6-b540-8cbb8012dfde tempest-CreateVolumesFromImageTest-694268940 None] Lock "cinder-quobyte-87cb3643-6a5f-4e5b-b0b3-f3f864b8e8e1" acquired by "delete_volume" :: waited 0.009s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:47:07 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[8868af02-ffd3-423b-ae30-83985fb3d103]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:47:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5fd2d109-1b77-42d6-b540-8cbb8012dfde tempest-CreateVolumesFromImageTest-694268940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-87cb3643-6a5f-4e5b-b0b3-f3f864b8e8e1 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:07 devstack sudo[89975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-87cb3643-6a5f-4e5b-b0b3-f3f864b8e8e1
Feb 28 04:47:07 devstack sudo[89975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:07 devstack sudo[89973]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3457573a-768a-4e86-8dcd-1e4b81e484ea tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525.2b132118-4686-4c16-87a5-1da0b093f9e7 1G" returned: 0 in 0.539s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3457573a-768a-4e86-8dcd-1e4b81e484ea tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f143321-1a8b-493c-ae41-d891b2af1525 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525.2b132118-4686-4c16-87a5-1da0b093f9e7 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:07 devstack sudo[89980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f143321-1a8b-493c-ae41-d891b2af1525 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525.2b132118-4686-4c16-87a5-1da0b093f9e7
Feb 28 04:47:07 devstack sudo[89980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:08 devstack sudo[89975]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5fd2d109-1b77-42d6-b540-8cbb8012dfde tempest-CreateVolumesFromImageTest-694268940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-87cb3643-6a5f-4e5b-b0b3-f3f864b8e8e1" returned: 0 in 0.497s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5fd2d109-1b77-42d6-b540-8cbb8012dfde tempest-CreateVolumesFromImageTest-694268940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-87cb3643-6a5f-4e5b-b0b3-f3f864b8e8e1 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:08 devstack sudo[89985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-87cb3643-6a5f-4e5b-b0b3-f3f864b8e8e1
Feb 28 04:47:08 devstack sudo[89985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:08 devstack sudo[89980]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3457573a-768a-4e86-8dcd-1e4b81e484ea tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f143321-1a8b-493c-ae41-d891b2af1525 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525.2b132118-4686-4c16-87a5-1da0b093f9e7" returned: 0 in 0.485s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:08 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-3457573a-768a-4e86-8dcd-1e4b81e484ea tempest-VolumesSnapshotTestJSON-1450209302 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525.2b132118-4686-4c16-87a5-1da0b093f9e7 is being set with open permissions: ugo+rw
Feb 28 04:47:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3457573a-768a-4e86-8dcd-1e4b81e484ea tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525.2b132118-4686-4c16-87a5-1da0b093f9e7 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:08 devstack sudo[89990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525.2b132118-4686-4c16-87a5-1da0b093f9e7
Feb 28 04:47:08 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:08 devstack sudo[89985]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5fd2d109-1b77-42d6-b540-8cbb8012dfde tempest-CreateVolumesFromImageTest-694268940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-87cb3643-6a5f-4e5b-b0b3-f3f864b8e8e1" returned: 0 in 0.519s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:08 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-5fd2d109-1b77-42d6-b540-8cbb8012dfde tempest-CreateVolumesFromImageTest-694268940 None] Lock "cinder-quobyte-87cb3643-6a5f-4e5b-b0b3-f3f864b8e8e1" released by "delete_volume" :: held 1.055s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:47:08 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-5fd2d109-1b77-42d6-b540-8cbb8012dfde tempest-CreateVolumesFromImageTest-694268940 None] Created reservations ['ba924900-c1a7-40e0-a3c3-7c9ae82c7b83', 'e53987ff-2b48-49f3-b9c9-e650ed80c117', 'bb163cb9-7a40-41a1-ba1e-7a089899ae9c', '754a05fb-f51d-4b1d-a282-4030db0cd2d5'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:47:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5fd2d109-1b77-42d6-b540-8cbb8012dfde tempest-CreateVolumesFromImageTest-694268940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:47:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5fd2d109-1b77-42d6-b540-8cbb8012dfde tempest-CreateVolumesFromImageTest-694268940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:47:08 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-5fd2d109-1b77-42d6-b540-8cbb8012dfde tempest-CreateVolumesFromImageTest-694268940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:47:08 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-5fd2d109-1b77-42d6-b540-8cbb8012dfde tempest-CreateVolumesFromImageTest-694268940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:47:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5fd2d109-1b77-42d6-b540-8cbb8012dfde tempest-CreateVolumesFromImageTest-694268940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:47:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5fd2d109-1b77-42d6-b540-8cbb8012dfde tempest-CreateVolumesFromImageTest-694268940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:08 devstack sudo[89994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:47:08 devstack sudo[89994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:08 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3457573a-768a-4e86-8dcd-1e4b81e484ea tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525.2b132118-4686-4c16-87a5-1da0b093f9e7" returned: 0 in 0.522s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3457573a-768a-4e86-8dcd-1e4b81e484ea tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:08 devstack sudo[89996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525.info
Feb 28 04:47:08 devstack sudo[89996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:09 devstack sudo[89994]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:09 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5fd2d109-1b77-42d6-b540-8cbb8012dfde tempest-CreateVolumesFromImageTest-694268940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.403s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:09 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-5fd2d109-1b77-42d6-b540-8cbb8012dfde tempest-CreateVolumesFromImageTest-694268940 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:47:09 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-5fd2d109-1b77-42d6-b540-8cbb8012dfde tempest-CreateVolumesFromImageTest-694268940 None] Deleted volume successfully.
Feb 28 04:47:09 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-5fd2d109-1b77-42d6-b540-8cbb8012dfde tempest-CreateVolumesFromImageTest-694268940 None] Lock "cinder-87cb3643-6a5f-4e5b-b0b3-f3f864b8e8e1-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:47:09 devstack sudo[89996]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:09 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3457573a-768a-4e86-8dcd-1e4b81e484ea tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525.info" returned: 0 in 0.393s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:09 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-3457573a-768a-4e86-8dcd-1e4b81e484ea tempest-VolumesSnapshotTestJSON-1450209302 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525.info is being set with open permissions: ugo+rw
Feb 28 04:47:09 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3457573a-768a-4e86-8dcd-1e4b81e484ea tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:09 devstack sudo[90000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525.info
Feb 28 04:47:09 devstack sudo[90000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:09 devstack sudo[90000]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:09 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3457573a-768a-4e86-8dcd-1e4b81e484ea tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525.info" returned: 0 in 0.388s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:09 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3457573a-768a-4e86-8dcd-1e4b81e484ea tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.881s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:47:09 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a1f57e5f-e191-49ce-a728-1ccf40c21a46 tempest-VolumesActionsTest-1301683667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.049s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:47:09 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-a1f57e5f-e191-49ce-a728-1ccf40c21a46 tempest-VolumesActionsTest-1301683667 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1945759942',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59564c3e-78f0-4937-97da-b5b00dd152fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7023634f56d4cbcac45204e8f63ed6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:47:04Z,use_quota=True,user_id='ee4ac0e21875401f96cfea20582ff403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:47:09 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-a1f57e5f-e191-49ce-a728-1ccf40c21a46 tempest-VolumesActionsTest-1301683667 None] Creating volume 59564c3e-78f0-4937-97da-b5b00dd152fa {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:47:09 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a1f57e5f-e191-49ce-a728-1ccf40c21a46 tempest-VolumesActionsTest-1301683667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:47:09 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a1f57e5f-e191-49ce-a728-1ccf40c21a46 tempest-VolumesActionsTest-1301683667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:47:09 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-a1f57e5f-e191-49ce-a728-1ccf40c21a46 tempest-VolumesActionsTest-1301683667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:47:09 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-a1f57e5f-e191-49ce-a728-1ccf40c21a46 tempest-VolumesActionsTest-1301683667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:47:09 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a1f57e5f-e191-49ce-a728-1ccf40c21a46 tempest-VolumesActionsTest-1301683667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:47:09 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-a1f57e5f-e191-49ce-a728-1ccf40c21a46 tempest-VolumesActionsTest-1301683667 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:47:09 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-a1f57e5f-e191-49ce-a728-1ccf40c21a46 tempest-VolumesActionsTest-1301683667 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:47:09 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a1f57e5f-e191-49ce-a728-1ccf40c21a46 tempest-VolumesActionsTest-1301683667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59564c3e-78f0-4937-97da-b5b00dd152fa 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:09 devstack sudo[90004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59564c3e-78f0-4937-97da-b5b00dd152fa 1073741824
Feb 28 04:47:09 devstack sudo[90004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:09 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-3457573a-768a-4e86-8dcd-1e4b81e484ea tempest-VolumesSnapshotTestJSON-1450209302 None] Create snapshot completed successfully
Feb 28 04:47:09 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-78f48ffa-1236-4b0b-abce-d09c244675fb tempest-CreateVolumesFromImageTest-694268940 None] Acquiring lock "cinder-6dac8202-4328-45da-be0b-4b2eb8ff364e-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:47:09 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-78f48ffa-1236-4b0b-abce-d09c244675fb tempest-CreateVolumesFromImageTest-694268940 None] Lock "cinder-6dac8202-4328-45da-be0b-4b2eb8ff364e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:47:09 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-78f48ffa-1236-4b0b-abce-d09c244675fb tempest-CreateVolumesFromImageTest-694268940 None] Acquiring lock "cinder-quobyte-6dac8202-4328-45da-be0b-4b2eb8ff364e" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:47:09 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-78f48ffa-1236-4b0b-abce-d09c244675fb tempest-CreateVolumesFromImageTest-694268940 None] Lock "cinder-quobyte-6dac8202-4328-45da-be0b-4b2eb8ff364e" acquired by "delete_volume" :: waited 0.009s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:47:09 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[841473d7-4d48-483e-8106-e2c98cd98c4b]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:47:09 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-78f48ffa-1236-4b0b-abce-d09c244675fb tempest-CreateVolumesFromImageTest-694268940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6dac8202-4328-45da-be0b-4b2eb8ff364e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:09 devstack sudo[90006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6dac8202-4328-45da-be0b-4b2eb8ff364e
Feb 28 04:47:09 devstack sudo[90006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:10 devstack sudo[90004]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a1f57e5f-e191-49ce-a728-1ccf40c21a46 tempest-VolumesActionsTest-1301683667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59564c3e-78f0-4937-97da-b5b00dd152fa 1073741824" returned: 0 in 0.501s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a1f57e5f-e191-49ce-a728-1ccf40c21a46 tempest-VolumesActionsTest-1301683667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59564c3e-78f0-4937-97da-b5b00dd152fa {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:10 devstack sudo[90011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59564c3e-78f0-4937-97da-b5b00dd152fa
Feb 28 04:47:10 devstack sudo[90011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:10 devstack sudo[90006]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-78f48ffa-1236-4b0b-abce-d09c244675fb tempest-CreateVolumesFromImageTest-694268940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6dac8202-4328-45da-be0b-4b2eb8ff364e" returned: 0 in 0.500s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-78f48ffa-1236-4b0b-abce-d09c244675fb tempest-CreateVolumesFromImageTest-694268940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6dac8202-4328-45da-be0b-4b2eb8ff364e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:10 devstack sudo[90016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6dac8202-4328-45da-be0b-4b2eb8ff364e
Feb 28 04:47:10 devstack sudo[90016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:10 devstack sudo[90011]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a1f57e5f-e191-49ce-a728-1ccf40c21a46 tempest-VolumesActionsTest-1301683667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59564c3e-78f0-4937-97da-b5b00dd152fa" returned: 0 in 0.397s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:10 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-a1f57e5f-e191-49ce-a728-1ccf40c21a46 tempest-VolumesActionsTest-1301683667 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:47:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a1f57e5f-e191-49ce-a728-1ccf40c21a46 tempest-VolumesActionsTest-1301683667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:47:10 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a1f57e5f-e191-49ce-a728-1ccf40c21a46 tempest-VolumesActionsTest-1301683667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (010c152c-1e9c-45b9-bf86-db83dfaa4769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59564c3e-78f0-4937-97da-b5b00dd152fa', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:47:10 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a1f57e5f-e191-49ce-a728-1ccf40c21a46 tempest-VolumesActionsTest-1301683667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0115f60-865e-4412-b7d9-84acb4ae1844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:47:10 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-a1f57e5f-e191-49ce-a728-1ccf40c21a46 tempest-VolumesActionsTest-1301683667 None] Volume volume-59564c3e-78f0-4937-97da-b5b00dd152fa (59564c3e-78f0-4937-97da-b5b00dd152fa): created successfully
Feb 28 04:47:10 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a1f57e5f-e191-49ce-a728-1ccf40c21a46 tempest-VolumesActionsTest-1301683667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0115f60-865e-4412-b7d9-84acb4ae1844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:47:10 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a1f57e5f-e191-49ce-a728-1ccf40c21a46 tempest-VolumesActionsTest-1301683667 None] Flow 'volume_create_manager' (30025e54-1ca4-4e30-b159-09a38000f786) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:47:10 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-a1f57e5f-e191-49ce-a728-1ccf40c21a46 tempest-VolumesActionsTest-1301683667 None] Created volume successfully.
Feb 28 04:47:10 devstack sudo[90016]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-78f48ffa-1236-4b0b-abce-d09c244675fb tempest-CreateVolumesFromImageTest-694268940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6dac8202-4328-45da-be0b-4b2eb8ff364e" returned: 0 in 0.418s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:10 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-78f48ffa-1236-4b0b-abce-d09c244675fb tempest-CreateVolumesFromImageTest-694268940 None] Lock "cinder-quobyte-6dac8202-4328-45da-be0b-4b2eb8ff364e" released by "delete_volume" :: held 0.958s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:47:10 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-78f48ffa-1236-4b0b-abce-d09c244675fb tempest-CreateVolumesFromImageTest-694268940 None] Created reservations ['87e77db6-74cb-4972-84f8-c2c21cd04e7d', 'ae372ab2-d1be-431e-bf9f-ba39cfd664a0', 'be469c64-0612-4334-b8fa-4c1e0a1794be', '5d74b354-c2c7-41e5-bc9b-16eee536686a'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:47:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-78f48ffa-1236-4b0b-abce-d09c244675fb tempest-CreateVolumesFromImageTest-694268940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:47:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-78f48ffa-1236-4b0b-abce-d09c244675fb tempest-CreateVolumesFromImageTest-694268940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:47:10 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-78f48ffa-1236-4b0b-abce-d09c244675fb tempest-CreateVolumesFromImageTest-694268940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:47:10 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-78f48ffa-1236-4b0b-abce-d09c244675fb tempest-CreateVolumesFromImageTest-694268940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:47:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-78f48ffa-1236-4b0b-abce-d09c244675fb tempest-CreateVolumesFromImageTest-694268940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:47:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-78f48ffa-1236-4b0b-abce-d09c244675fb tempest-CreateVolumesFromImageTest-694268940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:10 devstack sudo[90020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:47:10 devstack sudo[90020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-0b3bd6e3-9fc8-44c4-ba56-954e349d7e06 tempest-CreateVolumesFromImageTest-694268940 None] Acquiring lock "cinder-44312f19-0476-4652-9b51-d19a60cd57ce-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-0b3bd6e3-9fc8-44c4-ba56-954e349d7e06 tempest-CreateVolumesFromImageTest-694268940 None] Lock "cinder-44312f19-0476-4652-9b51-d19a60cd57ce-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Flow 'volume_create_manager' (113c36cd-0624-4329-9403-668777b8f9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb963314-6ca1-4276-bbef-2b96275530a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-0b3bd6e3-9fc8-44c4-ba56-954e349d7e06 tempest-CreateVolumesFromImageTest-694268940 None] Acquiring lock "cinder-quobyte-44312f19-0476-4652-9b51-d19a60cd57ce" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb963314-6ca1-4276-bbef-2b96275530a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1079287982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18cdfa8e-1088-4b06-9c2c-b14a516b135b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38e49879b3b24d2d9b0adf1476729ddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:47:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=2b132118-4686-4c16-87a5-1da0b093f9e7,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:47:11Z,use_quota=True,user_id='5ddc0b80823a4acc8f06430d30a63512',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da52dfce-05b0-47a8-bde5-75bfe76ecb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da52dfce-05b0-47a8-bde5-75bfe76ecb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46b38145-687d-42a3-b896-41b1aa313f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46b38145-687d-42a3-b896-41b1aa313f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '18cdfa8e-1088-4b06-9c2c-b14a516b135b', 'volume_name': 'volume-18cdfa8e-1088-4b06-9c2c-b14a516b135b', 'volume_size': 2, 'snapshot_id': '2b132118-4686-4c16-87a5-1da0b093f9e7'}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df7fd020-4ac1-4e10-b6e8-0c87b17e9897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df7fd020-4ac1-4e10-b6e8-0c87b17e9897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71de2c1a-8c81-4ddd-93ae-cb91adde2ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:47:11 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Volume 18cdfa8e-1088-4b06-9c2c-b14a516b135b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-18cdfa8e-1088-4b06-9c2c-b14a516b135b', 'volume_size': 2, 'snapshot_id': '2b132118-4686-4c16-87a5-1da0b093f9e7'}
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-0b3bd6e3-9fc8-44c4-ba56-954e349d7e06 tempest-CreateVolumesFromImageTest-694268940 None] Lock "cinder-quobyte-44312f19-0476-4652-9b51-d19a60cd57ce" acquired by "delete_volume" :: waited 0.050s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[061dfe54-54ab-4a3e-9b50-6628a9c6679b]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-0b3bd6e3-9fc8-44c4-ba56-954e349d7e06 tempest-CreateVolumesFromImageTest-694268940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-44312f19-0476-4652-9b51-d19a60cd57ce {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Acquiring lock "cinder-quobyte-2b132118-4686-4c16-87a5-1da0b093f9e7-18cdfa8e-1088-4b06-9c2c-b14a516b135b" by "_create_volume_from_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "cinder-quobyte-2b132118-4686-4c16-87a5-1da0b093f9e7-18cdfa8e-1088-4b06-9c2c-b14a516b135b" acquired by "_create_volume_from_snapshot" :: waited 0.011s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Creating volume 18cdfa8e-1088-4b06-9c2c-b14a516b135b from snapshot 2b132118-4686-4c16-87a5-1da0b093f9e7 {{(pid=84248) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Acquiring lock "cinder-quobyte-18cdfa8e-1088-4b06-9c2c-b14a516b135b" by "_copy_volume_from_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "cinder-quobyte-18cdfa8e-1088-4b06-9c2c-b14a516b135b" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] snapshot: 2b132118-4686-4c16-87a5-1da0b093f9e7, volume: 18cdfa8e-1088-4b06-9c2c-b14a516b135b,  {{(pid=84248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab81d7d-d1dc-47aa-91c5-3a2d16fbaaa1]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525.2b132118-4686-4c16-87a5-1da0b093f9e7 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:11 devstack sudo[90022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-44312f19-0476-4652-9b51-d19a60cd57ce
Feb 28 04:47:11 devstack sudo[90022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:11 devstack sudo[90023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525.2b132118-4686-4c16-87a5-1da0b093f9e7
Feb 28 04:47:11 devstack sudo[90023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:11 devstack sudo[90020]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-78f48ffa-1236-4b0b-abce-d09c244675fb tempest-CreateVolumesFromImageTest-694268940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.461s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-78f48ffa-1236-4b0b-abce-d09c244675fb tempest-CreateVolumesFromImageTest-694268940 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:47:11 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-78f48ffa-1236-4b0b-abce-d09c244675fb tempest-CreateVolumesFromImageTest-694268940 None] Deleted volume successfully.
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-78f48ffa-1236-4b0b-abce-d09c244675fb tempest-CreateVolumesFromImageTest-694268940 None] Lock "cinder-6dac8202-4328-45da-be0b-4b2eb8ff364e-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:47:11 devstack sudo[90023]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525.2b132118-4686-4c16-87a5-1da0b093f9e7" returned: 0 in 0.510s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f143321-1a8b-493c-ae41-d891b2af1525(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] will copy from snapshot at /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525 {{(pid=84248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Creating direct copy from snapshot {{(pid=84248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[70988b22-3a8e-4f40-bf8c-78f2afd718a0]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:11 devstack sudo[90022]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-0b3bd6e3-9fc8-44c4-ba56-954e349d7e06 tempest-CreateVolumesFromImageTest-694268940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-44312f19-0476-4652-9b51-d19a60cd57ce" returned: 0 in 0.591s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-0b3bd6e3-9fc8-44c4-ba56-954e349d7e06 tempest-CreateVolumesFromImageTest-694268940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-44312f19-0476-4652-9b51-d19a60cd57ce {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:11 devstack sudo[90034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-44312f19-0476-4652-9b51-d19a60cd57ce
Feb 28 04:47:11 devstack sudo[90034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:11 devstack sudo[90033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525
Feb 28 04:47:11 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:12 devstack sudo[90034]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-0b3bd6e3-9fc8-44c4-ba56-954e349d7e06 tempest-CreateVolumesFromImageTest-694268940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-44312f19-0476-4652-9b51-d19a60cd57ce" returned: 0 in 0.445s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:12 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-0b3bd6e3-9fc8-44c4-ba56-954e349d7e06 tempest-CreateVolumesFromImageTest-694268940 None] Lock "cinder-quobyte-44312f19-0476-4652-9b51-d19a60cd57ce" released by "delete_volume" :: held 1.060s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:47:12 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-0b3bd6e3-9fc8-44c4-ba56-954e349d7e06 tempest-CreateVolumesFromImageTest-694268940 None] Created reservations ['82c25640-8cb5-4554-907a-17591dad7ea3', '467cd9fb-880d-4462-82ac-b675c086297e', '4b55c545-d377-472b-a563-0119a08d1938', '6da724c8-c750-4282-8353-e4bc6348bc19'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:47:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-0b3bd6e3-9fc8-44c4-ba56-954e349d7e06 tempest-CreateVolumesFromImageTest-694268940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:47:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-0b3bd6e3-9fc8-44c4-ba56-954e349d7e06 tempest-CreateVolumesFromImageTest-694268940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:47:12 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-0b3bd6e3-9fc8-44c4-ba56-954e349d7e06 tempest-CreateVolumesFromImageTest-694268940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:47:12 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-0b3bd6e3-9fc8-44c4-ba56-954e349d7e06 tempest-CreateVolumesFromImageTest-694268940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:47:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-0b3bd6e3-9fc8-44c4-ba56-954e349d7e06 tempest-CreateVolumesFromImageTest-694268940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:47:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-0b3bd6e3-9fc8-44c4-ba56-954e349d7e06 tempest-CreateVolumesFromImageTest-694268940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:12 devstack sudo[90043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:47:12 devstack sudo[90043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:12 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525" returned: 0 in 0.590s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:12 devstack cinder-volume[84248]: DEBUG cinder.utils [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Path /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-18cdfa8e-1088-4b06-9c2c-b14a516b135b not found in is_blk_device check {{(pid=84248) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 28 04:47:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-18cdfa8e-1088-4b06-9c2c-b14a516b135b {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:12 devstack sudo[90045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-18cdfa8e-1088-4b06-9c2c-b14a516b135b
Feb 28 04:47:12 devstack sudo[90045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:12 devstack sudo[90043]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-0b3bd6e3-9fc8-44c4-ba56-954e349d7e06 tempest-CreateVolumesFromImageTest-694268940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.453s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:12 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-0b3bd6e3-9fc8-44c4-ba56-954e349d7e06 tempest-CreateVolumesFromImageTest-694268940 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:47:12 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-0b3bd6e3-9fc8-44c4-ba56-954e349d7e06 tempest-CreateVolumesFromImageTest-694268940 None] Deleted volume successfully.
Feb 28 04:47:12 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-0b3bd6e3-9fc8-44c4-ba56-954e349d7e06 tempest-CreateVolumesFromImageTest-694268940 None] Lock "cinder-44312f19-0476-4652-9b51-d19a60cd57ce-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:47:13 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-7f8f209b-3529-4226-84cb-c80bbca595af tempest-CreateVolumesFromImageTest-694268940 None] Acquiring lock "cinder-49d10e58-6ec2-4a61-bb73-e917f9685638-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:47:13 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-7f8f209b-3529-4226-84cb-c80bbca595af tempest-CreateVolumesFromImageTest-694268940 None] Lock "cinder-49d10e58-6ec2-4a61-bb73-e917f9685638-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:47:13 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-7f8f209b-3529-4226-84cb-c80bbca595af tempest-CreateVolumesFromImageTest-694268940 None] Acquiring lock "cinder-quobyte-49d10e58-6ec2-4a61-bb73-e917f9685638" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:47:13 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-7f8f209b-3529-4226-84cb-c80bbca595af tempest-CreateVolumesFromImageTest-694268940 None] Lock "cinder-quobyte-49d10e58-6ec2-4a61-bb73-e917f9685638" acquired by "delete_volume" :: waited 0.017s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:47:13 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d99baa-ca7c-4b61-96fa-4d32da34483a]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:47:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7f8f209b-3529-4226-84cb-c80bbca595af tempest-CreateVolumesFromImageTest-694268940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-49d10e58-6ec2-4a61-bb73-e917f9685638 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:13 devstack sudo[90058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-49d10e58-6ec2-4a61-bb73-e917f9685638
Feb 28 04:47:13 devstack sudo[90058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:14 devstack sudo[90045]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-18cdfa8e-1088-4b06-9c2c-b14a516b135b" returned: 0 in 2.289s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:14 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a76c44-2849-4fc9-95fe-29e6415cef0b]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:47:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:14 devstack sudo[90058]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7f8f209b-3529-4226-84cb-c80bbca595af tempest-CreateVolumesFromImageTest-694268940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-49d10e58-6ec2-4a61-bb73-e917f9685638" returned: 0 in 1.244s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7f8f209b-3529-4226-84cb-c80bbca595af tempest-CreateVolumesFromImageTest-694268940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-49d10e58-6ec2-4a61-bb73-e917f9685638 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:14 devstack sudo[90064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-49d10e58-6ec2-4a61-bb73-e917f9685638
Feb 28 04:47:14 devstack sudo[90064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:14 devstack sudo[90063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525
Feb 28 04:47:14 devstack sudo[90063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:15 devstack sudo[90064]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7f8f209b-3529-4226-84cb-c80bbca595af tempest-CreateVolumesFromImageTest-694268940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-49d10e58-6ec2-4a61-bb73-e917f9685638" returned: 0 in 0.399s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:15 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-7f8f209b-3529-4226-84cb-c80bbca595af tempest-CreateVolumesFromImageTest-694268940 None] Lock "cinder-quobyte-49d10e58-6ec2-4a61-bb73-e917f9685638" released by "delete_volume" :: held 1.681s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:47:15 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-7f8f209b-3529-4226-84cb-c80bbca595af tempest-CreateVolumesFromImageTest-694268940 None] Created reservations ['23aee2a7-7c3d-4289-bf38-e9304f5b219f', 'e595d99f-4e10-4cc2-8069-725ba103d766', '15ea601d-5eb0-469a-8eb3-9135d3171e49', 'b52bff33-59ac-4bab-a1a7-af00b609c747'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:47:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-7f8f209b-3529-4226-84cb-c80bbca595af tempest-CreateVolumesFromImageTest-694268940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:47:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-7f8f209b-3529-4226-84cb-c80bbca595af tempest-CreateVolumesFromImageTest-694268940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:47:15 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-7f8f209b-3529-4226-84cb-c80bbca595af tempest-CreateVolumesFromImageTest-694268940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:47:15 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-7f8f209b-3529-4226-84cb-c80bbca595af tempest-CreateVolumesFromImageTest-694268940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:47:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-7f8f209b-3529-4226-84cb-c80bbca595af tempest-CreateVolumesFromImageTest-694268940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:47:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7f8f209b-3529-4226-84cb-c80bbca595af tempest-CreateVolumesFromImageTest-694268940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:15 devstack sudo[90070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:47:15 devstack sudo[90070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:15 devstack sudo[90063]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525" returned: 0 in 0.583s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:15 devstack cinder-volume[84248]: DEBUG cinder.image.image_utils [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Image conversion details: src /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525, size 1024.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-18cdfa8e-1088-4b06-9c2c-b14a516b135b {{(pid=84248) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 28 04:47:15 devstack cinder-volume[84248]: INFO cinder.image.image_utils [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Converted 1024.00 MB image at 447.17 MB/s
Feb 28 04:47:15 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-18cdfa8e-1088-4b06-9c2c-b14a516b135b is being set with open permissions: ugo+rw
Feb 28 04:47:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-18cdfa8e-1088-4b06-9c2c-b14a516b135b {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:15 devstack sudo[90073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-18cdfa8e-1088-4b06-9c2c-b14a516b135b
Feb 28 04:47:15 devstack sudo[90073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:15 devstack sudo[90070]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7f8f209b-3529-4226-84cb-c80bbca595af tempest-CreateVolumesFromImageTest-694268940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.413s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:15 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-7f8f209b-3529-4226-84cb-c80bbca595af tempest-CreateVolumesFromImageTest-694268940 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:47:15 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-7f8f209b-3529-4226-84cb-c80bbca595af tempest-CreateVolumesFromImageTest-694268940 None] Deleted volume successfully.
Feb 28 04:47:15 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-7f8f209b-3529-4226-84cb-c80bbca595af tempest-CreateVolumesFromImageTest-694268940 None] Lock "cinder-49d10e58-6ec2-4a61-bb73-e917f9685638-delete_volume" released by "delete_volume" :: held 2.254s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:47:15 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-3de42ea4-ffcd-4adf-a888-ff1863119cbe tempest-CreateVolumesFromImageTest-694268940 None] Acquiring lock "cinder-79dd7500-d311-4531-a23b-5947776112c6-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:47:15 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-3de42ea4-ffcd-4adf-a888-ff1863119cbe tempest-CreateVolumesFromImageTest-694268940 None] Lock "cinder-79dd7500-d311-4531-a23b-5947776112c6-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:47:15 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-3de42ea4-ffcd-4adf-a888-ff1863119cbe tempest-CreateVolumesFromImageTest-694268940 None] Acquiring lock "cinder-quobyte-79dd7500-d311-4531-a23b-5947776112c6" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:47:15 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-3de42ea4-ffcd-4adf-a888-ff1863119cbe tempest-CreateVolumesFromImageTest-694268940 None] Lock "cinder-quobyte-79dd7500-d311-4531-a23b-5947776112c6" acquired by "delete_volume" :: waited 0.007s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:47:15 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e1f7c9-a742-4e90-b442-7f3af31612cb]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:47:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3de42ea4-ffcd-4adf-a888-ff1863119cbe tempest-CreateVolumesFromImageTest-694268940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-79dd7500-d311-4531-a23b-5947776112c6 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:15 devstack sudo[90073]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-18cdfa8e-1088-4b06-9c2c-b14a516b135b" returned: 0 in 0.470s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:15 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "cinder-quobyte-18cdfa8e-1088-4b06-9c2c-b14a516b135b" released by "_copy_volume_from_snapshot" :: held 4.500s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:47:15 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "cinder-quobyte-2b132118-4686-4c16-87a5-1da0b093f9e7-18cdfa8e-1088-4b06-9c2c-b14a516b135b" released by "_create_volume_from_snapshot" :: held 4.515s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:47:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.527s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:47:15 devstack sudo[90077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-79dd7500-d311-4531-a23b-5947776112c6
Feb 28 04:47:15 devstack sudo[90077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:15 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71de2c1a-8c81-4ddd-93ae-cb91adde2ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18cdfa8e-1088-4b06-9c2c-b14a516b135b', 'volume_size': 2, 'snapshot_id': '2b132118-4686-4c16-87a5-1da0b093f9e7'}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:47:15 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36b49a63-bb4c-4319-a6a1-7787206fb9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:47:15 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Volume volume-18cdfa8e-1088-4b06-9c2c-b14a516b135b (18cdfa8e-1088-4b06-9c2c-b14a516b135b): created successfully
Feb 28 04:47:15 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36b49a63-bb4c-4319-a6a1-7787206fb9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:47:15 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Flow 'volume_create_manager' (113c36cd-0624-4329-9403-668777b8f9da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:47:15 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-a4189ecd-95d1-4085-acfa-2109243e84cf tempest-VolumesSnapshotTestJSON-1450209302 None] Created volume successfully.
Feb 28 04:47:16 devstack sudo[90077]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3de42ea4-ffcd-4adf-a888-ff1863119cbe tempest-CreateVolumesFromImageTest-694268940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-79dd7500-d311-4531-a23b-5947776112c6" returned: 0 in 0.460s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3de42ea4-ffcd-4adf-a888-ff1863119cbe tempest-CreateVolumesFromImageTest-694268940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-79dd7500-d311-4531-a23b-5947776112c6 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:16 devstack sudo[90082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-79dd7500-d311-4531-a23b-5947776112c6
Feb 28 04:47:16 devstack sudo[90082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:16 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-96a08ffc-ef28-49e9-9302-92a5d9d6240e tempest-VolumesSnapshotTestJSON-1450209302 None] Acquiring lock "cinder-18cdfa8e-1088-4b06-9c2c-b14a516b135b-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:47:16 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-96a08ffc-ef28-49e9-9302-92a5d9d6240e tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "cinder-18cdfa8e-1088-4b06-9c2c-b14a516b135b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:47:16 devstack sudo[90082]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:16 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-96a08ffc-ef28-49e9-9302-92a5d9d6240e tempest-VolumesSnapshotTestJSON-1450209302 None] Acquiring lock "cinder-quobyte-18cdfa8e-1088-4b06-9c2c-b14a516b135b" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:47:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3de42ea4-ffcd-4adf-a888-ff1863119cbe tempest-CreateVolumesFromImageTest-694268940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-79dd7500-d311-4531-a23b-5947776112c6" returned: 0 in 0.475s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:16 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-3de42ea4-ffcd-4adf-a888-ff1863119cbe tempest-CreateVolumesFromImageTest-694268940 None] Lock "cinder-quobyte-79dd7500-d311-4531-a23b-5947776112c6" released by "delete_volume" :: held 0.960s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:47:16 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-96a08ffc-ef28-49e9-9302-92a5d9d6240e tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "cinder-quobyte-18cdfa8e-1088-4b06-9c2c-b14a516b135b" acquired by "delete_volume" :: waited 0.019s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:47:16 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a8731c-edee-4614-b468-b39bb7e52fe2]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:47:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-96a08ffc-ef28-49e9-9302-92a5d9d6240e tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-18cdfa8e-1088-4b06-9c2c-b14a516b135b {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:16 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-3de42ea4-ffcd-4adf-a888-ff1863119cbe tempest-CreateVolumesFromImageTest-694268940 None] Created reservations ['ea5b287c-7b29-4f82-a8ff-4067c71fc0cc', '9df63732-6b43-40a7-8116-d459fff6381f', '1ff924f5-1acd-4941-9b81-3b253947dd19', '8c7a462e-1377-4bfb-8c07-157fe757419f'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:47:16 devstack sudo[90085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-18cdfa8e-1088-4b06-9c2c-b14a516b135b
Feb 28 04:47:16 devstack sudo[90085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3de42ea4-ffcd-4adf-a888-ff1863119cbe tempest-CreateVolumesFromImageTest-694268940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:47:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3de42ea4-ffcd-4adf-a888-ff1863119cbe tempest-CreateVolumesFromImageTest-694268940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:47:16 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-3de42ea4-ffcd-4adf-a888-ff1863119cbe tempest-CreateVolumesFromImageTest-694268940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:47:16 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-3de42ea4-ffcd-4adf-a888-ff1863119cbe tempest-CreateVolumesFromImageTest-694268940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:47:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3de42ea4-ffcd-4adf-a888-ff1863119cbe tempest-CreateVolumesFromImageTest-694268940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:47:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3de42ea4-ffcd-4adf-a888-ff1863119cbe tempest-CreateVolumesFromImageTest-694268940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:16 devstack sudo[90087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:47:16 devstack sudo[90087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:17 devstack sudo[90085]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-96a08ffc-ef28-49e9-9302-92a5d9d6240e tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-18cdfa8e-1088-4b06-9c2c-b14a516b135b" returned: 0 in 0.703s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-96a08ffc-ef28-49e9-9302-92a5d9d6240e tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-18cdfa8e-1088-4b06-9c2c-b14a516b135b {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:17 devstack sudo[90087]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3de42ea4-ffcd-4adf-a888-ff1863119cbe tempest-CreateVolumesFromImageTest-694268940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.572s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:17 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-3de42ea4-ffcd-4adf-a888-ff1863119cbe tempest-CreateVolumesFromImageTest-694268940 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:47:17 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-3de42ea4-ffcd-4adf-a888-ff1863119cbe tempest-CreateVolumesFromImageTest-694268940 None] Deleted volume successfully.
Feb 28 04:47:17 devstack sudo[90093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-18cdfa8e-1088-4b06-9c2c-b14a516b135b
Feb 28 04:47:17 devstack sudo[90093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:17 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-3de42ea4-ffcd-4adf-a888-ff1863119cbe tempest-CreateVolumesFromImageTest-694268940 None] Lock "cinder-79dd7500-d311-4531-a23b-5947776112c6-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:47:17 devstack sudo[90093]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-96a08ffc-ef28-49e9-9302-92a5d9d6240e tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-18cdfa8e-1088-4b06-9c2c-b14a516b135b" returned: 0 in 0.593s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:17 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-96a08ffc-ef28-49e9-9302-92a5d9d6240e tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "cinder-quobyte-18cdfa8e-1088-4b06-9c2c-b14a516b135b" released by "delete_volume" :: held 1.324s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:47:17 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-96a08ffc-ef28-49e9-9302-92a5d9d6240e tempest-VolumesSnapshotTestJSON-1450209302 None] Created reservations ['69f8b653-9473-42d5-a56b-bd233fad91a5', '942d9f0c-6eff-47fb-ac42-bedaa7f1fda6', 'f0aa5766-8365-4112-b326-f4f7db088f3c', '265a6ceb-d6a2-4e95-8a33-02de3941aa30'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:47:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-96a08ffc-ef28-49e9-9302-92a5d9d6240e tempest-VolumesSnapshotTestJSON-1450209302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:47:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-96a08ffc-ef28-49e9-9302-92a5d9d6240e tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:47:18 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-96a08ffc-ef28-49e9-9302-92a5d9d6240e tempest-VolumesSnapshotTestJSON-1450209302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:47:18 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-96a08ffc-ef28-49e9-9302-92a5d9d6240e tempest-VolumesSnapshotTestJSON-1450209302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:47:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-96a08ffc-ef28-49e9-9302-92a5d9d6240e tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:47:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-96a08ffc-ef28-49e9-9302-92a5d9d6240e tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:18 devstack sudo[90131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:47:18 devstack sudo[90131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:18 devstack sudo[90131]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-96a08ffc-ef28-49e9-9302-92a5d9d6240e tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.419s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:18 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-96a08ffc-ef28-49e9-9302-92a5d9d6240e tempest-VolumesSnapshotTestJSON-1450209302 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:47:18 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-96a08ffc-ef28-49e9-9302-92a5d9d6240e tempest-VolumesSnapshotTestJSON-1450209302 None] Deleted volume successfully.
Feb 28 04:47:18 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-96a08ffc-ef28-49e9-9302-92a5d9d6240e tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "cinder-18cdfa8e-1088-4b06-9c2c-b14a516b135b-delete_volume" released by "delete_volume" :: held 1.955s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:47:18 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d8ae7e7a-b707-4c04-bcde-4266814d2b39 tempest-VolumesSnapshotTestJSON-1450209302 None] Acquiring lock "cinder-2b132118-4686-4c16-87a5-1da0b093f9e7-delete_snapshot" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:47:18 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d8ae7e7a-b707-4c04-bcde-4266814d2b39 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "cinder-2b132118-4686-4c16-87a5-1da0b093f9e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:47:18 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d8ae7e7a-b707-4c04-bcde-4266814d2b39 tempest-VolumesSnapshotTestJSON-1450209302 None] Acquiring lock "cinder-quobyte-7f143321-1a8b-493c-ae41-d891b2af1525" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:47:18 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d8ae7e7a-b707-4c04-bcde-4266814d2b39 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "cinder-quobyte-7f143321-1a8b-493c-ae41-d891b2af1525" acquired by "delete_snapshot" :: waited 0.007s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:47:18 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d8ae7e7a-b707-4c04-bcde-4266814d2b39 tempest-VolumesSnapshotTestJSON-1450209302 None] Acquiring lock "cinder-quobyte-2b132118-4686-4c16-87a5-1da0b093f9e7" by "_delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:47:18 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d8ae7e7a-b707-4c04-bcde-4266814d2b39 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "cinder-quobyte-2b132118-4686-4c16-87a5-1da0b093f9e7" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:47:18 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-d8ae7e7a-b707-4c04-bcde-4266814d2b39 tempest-VolumesSnapshotTestJSON-1450209302 None] Deleting offline snapshot 2b132118-4686-4c16-87a5-1da0b093f9e7 of volume 7f143321-1a8b-493c-ae41-d891b2af1525 {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 04:47:18 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-d8ae7e7a-b707-4c04-bcde-4266814d2b39 tempest-VolumesSnapshotTestJSON-1450209302 None] snapshot_file for this snap is: volume-7f143321-1a8b-493c-ae41-d891b2af1525.2b132118-4686-4c16-87a5-1da0b093f9e7 {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 04:47:18 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b202bd-0692-4102-af7c-51086a278e1d]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:47:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d8ae7e7a-b707-4c04-bcde-4266814d2b39 tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525.2b132118-4686-4c16-87a5-1da0b093f9e7 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:18 devstack sudo[90149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525.2b132118-4686-4c16-87a5-1da0b093f9e7
Feb 28 04:47:18 devstack sudo[90149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:19 devstack sudo[90149]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d8ae7e7a-b707-4c04-bcde-4266814d2b39 tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525.2b132118-4686-4c16-87a5-1da0b093f9e7" returned: 0 in 0.475s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:19 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-d8ae7e7a-b707-4c04-bcde-4266814d2b39 tempest-VolumesSnapshotTestJSON-1450209302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f143321-1a8b-493c-ae41-d891b2af1525(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:47:19 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[9208e163-30e7-4301-91e1-414cd855707a]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:47:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d8ae7e7a-b707-4c04-bcde-4266814d2b39 tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:19 devstack sudo[90160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525
Feb 28 04:47:19 devstack sudo[90160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:19 devstack sudo[90160]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d8ae7e7a-b707-4c04-bcde-4266814d2b39 tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525" returned: 0 in 0.467s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d8ae7e7a-b707-4c04-bcde-4266814d2b39 tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525.2b132118-4686-4c16-87a5-1da0b093f9e7 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:19 devstack sudo[90166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525.2b132118-4686-4c16-87a5-1da0b093f9e7
Feb 28 04:47:19 devstack sudo[90166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:20 devstack sudo[90166]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d8ae7e7a-b707-4c04-bcde-4266814d2b39 tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525.2b132118-4686-4c16-87a5-1da0b093f9e7" returned: 0 in 0.448s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d8ae7e7a-b707-4c04-bcde-4266814d2b39 tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525.2b132118-4686-4c16-87a5-1da0b093f9e7 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:20 devstack sudo[90171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525.2b132118-4686-4c16-87a5-1da0b093f9e7
Feb 28 04:47:20 devstack sudo[90171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:20 devstack sudo[90171]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d8ae7e7a-b707-4c04-bcde-4266814d2b39 tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525.2b132118-4686-4c16-87a5-1da0b093f9e7" returned: 0 in 0.401s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:20 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d8ae7e7a-b707-4c04-bcde-4266814d2b39 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "cinder-quobyte-2b132118-4686-4c16-87a5-1da0b093f9e7" released by "_delete_snapshot" :: held 1.851s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:47:20 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d8ae7e7a-b707-4c04-bcde-4266814d2b39 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "cinder-quobyte-7f143321-1a8b-493c-ae41-d891b2af1525" released by "delete_snapshot" :: held 1.866s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:47:20 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-d8ae7e7a-b707-4c04-bcde-4266814d2b39 tempest-VolumesSnapshotTestJSON-1450209302 None] Created reservations ['60766d92-3b34-4516-a632-48aecdf62c45', '731df4ae-a264-4ab9-93d3-286d86a62683', '98cc6b52-c5c1-4329-b053-6625c33a8f89', 'c919ea0c-88c9-411b-a262-bf810a1b653e'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:47:20 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-d8ae7e7a-b707-4c04-bcde-4266814d2b39 tempest-VolumesSnapshotTestJSON-1450209302 None] Delete snapshot completed successfully.
Feb 28 04:47:20 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d8ae7e7a-b707-4c04-bcde-4266814d2b39 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "cinder-2b132118-4686-4c16-87a5-1da0b093f9e7-delete_snapshot" released by "delete_snapshot" :: held 1.939s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:47:20 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-b650dc65-e0f4-4ae5-9ce9-bf2e25e74f98 tempest-VolumesSnapshotTestJSON-1450209302 None] Acquiring lock "cinder-7f143321-1a8b-493c-ae41-d891b2af1525-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:47:20 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-b650dc65-e0f4-4ae5-9ce9-bf2e25e74f98 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "cinder-7f143321-1a8b-493c-ae41-d891b2af1525-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:47:20 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-b650dc65-e0f4-4ae5-9ce9-bf2e25e74f98 tempest-VolumesSnapshotTestJSON-1450209302 None] Acquiring lock "cinder-quobyte-7f143321-1a8b-493c-ae41-d891b2af1525" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:47:20 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-b650dc65-e0f4-4ae5-9ce9-bf2e25e74f98 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "cinder-quobyte-7f143321-1a8b-493c-ae41-d891b2af1525" acquired by "delete_volume" :: waited 0.009s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:47:20 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7f9c47-d8ae-4056-a861-db3453ca74bd]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:47:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b650dc65-e0f4-4ae5-9ce9-bf2e25e74f98 tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:21 devstack sudo[90174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525
Feb 28 04:47:21 devstack sudo[90174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:21 devstack sudo[90174]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b650dc65-e0f4-4ae5-9ce9-bf2e25e74f98 tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525" returned: 0 in 0.488s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b650dc65-e0f4-4ae5-9ce9-bf2e25e74f98 tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:21 devstack sudo[90182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525
Feb 28 04:47:21 devstack sudo[90182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:21 devstack sudo[90182]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b650dc65-e0f4-4ae5-9ce9-bf2e25e74f98 tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7f143321-1a8b-493c-ae41-d891b2af1525" returned: 0 in 0.407s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:21 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-b650dc65-e0f4-4ae5-9ce9-bf2e25e74f98 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "cinder-quobyte-7f143321-1a8b-493c-ae41-d891b2af1525" released by "delete_volume" :: held 0.927s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:47:21 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-b650dc65-e0f4-4ae5-9ce9-bf2e25e74f98 tempest-VolumesSnapshotTestJSON-1450209302 None] Created reservations ['0699877f-4f8f-4a19-b156-4c5866516730', 'e81592a8-786d-476a-9546-455ed3282845', '9e11d3c1-7ac2-4d22-9afd-9387c50554c1', 'eb5cf640-33c9-4d9f-a70d-2582b3d62b28'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:47:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b650dc65-e0f4-4ae5-9ce9-bf2e25e74f98 tempest-VolumesSnapshotTestJSON-1450209302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:47:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b650dc65-e0f4-4ae5-9ce9-bf2e25e74f98 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:47:21 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-b650dc65-e0f4-4ae5-9ce9-bf2e25e74f98 tempest-VolumesSnapshotTestJSON-1450209302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:47:21 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-b650dc65-e0f4-4ae5-9ce9-bf2e25e74f98 tempest-VolumesSnapshotTestJSON-1450209302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:47:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b650dc65-e0f4-4ae5-9ce9-bf2e25e74f98 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:47:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b650dc65-e0f4-4ae5-9ce9-bf2e25e74f98 tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:21 devstack sudo[90185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:47:21 devstack sudo[90185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:22 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-897ad53c-1f83-4701-8045-9dbbe7d70450 tempest-VolumesSnapshotTestJSON-1450209302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:47:22 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-897ad53c-1f83-4701-8045-9dbbe7d70450 tempest-VolumesSnapshotTestJSON-1450209302 None] Flow 'volume_create_manager' (ba9858d8-306f-4749-a64b-2a93d8525670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:47:22 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-897ad53c-1f83-4701-8045-9dbbe7d70450 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7b9905-6099-4bc5-9615-16e44ccb824a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:47:22 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-897ad53c-1f83-4701-8045-9dbbe7d70450 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7b9905-6099-4bc5-9615-16e44ccb824a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-59673778',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9696b1fc-48af-4933-8c8a-821e3ea124f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38e49879b3b24d2d9b0adf1476729ddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:47:22Z,use_quota=True,user_id='5ddc0b80823a4acc8f06430d30a63512',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:47:22 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-897ad53c-1f83-4701-8045-9dbbe7d70450 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14e0aade-34e1-4235-b86c-1901e0d6b3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:47:22 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-897ad53c-1f83-4701-8045-9dbbe7d70450 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14e0aade-34e1-4235-b86c-1901e0d6b3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:47:22 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-897ad53c-1f83-4701-8045-9dbbe7d70450 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fec46d27-c7ba-474b-8c86-2431a7803ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:47:22 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-897ad53c-1f83-4701-8045-9dbbe7d70450 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fec46d27-c7ba-474b-8c86-2431a7803ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9696b1fc-48af-4933-8c8a-821e3ea124f6', 'volume_name': 'volume-9696b1fc-48af-4933-8c8a-821e3ea124f6', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:47:22 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-897ad53c-1f83-4701-8045-9dbbe7d70450 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09c25f2c-c473-4d7b-9cde-cfd58000deee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:47:22 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-897ad53c-1f83-4701-8045-9dbbe7d70450 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09c25f2c-c473-4d7b-9cde-cfd58000deee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:47:22 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-897ad53c-1f83-4701-8045-9dbbe7d70450 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50c02ccd-724e-4102-903b-a292d95f2d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:47:22 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-897ad53c-1f83-4701-8045-9dbbe7d70450 tempest-VolumesSnapshotTestJSON-1450209302 None] Volume 9696b1fc-48af-4933-8c8a-821e3ea124f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9696b1fc-48af-4933-8c8a-821e3ea124f6', 'volume_size': 1}
Feb 28 04:47:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-897ad53c-1f83-4701-8045-9dbbe7d70450 tempest-VolumesSnapshotTestJSON-1450209302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:47:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-897ad53c-1f83-4701-8045-9dbbe7d70450 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:47:22 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-897ad53c-1f83-4701-8045-9dbbe7d70450 tempest-VolumesSnapshotTestJSON-1450209302 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-59673778',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9696b1fc-48af-4933-8c8a-821e3ea124f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38e49879b3b24d2d9b0adf1476729ddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:47:22Z,use_quota=True,user_id='5ddc0b80823a4acc8f06430d30a63512',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:47:22 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-897ad53c-1f83-4701-8045-9dbbe7d70450 tempest-VolumesSnapshotTestJSON-1450209302 None] Creating volume 9696b1fc-48af-4933-8c8a-821e3ea124f6 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:47:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-897ad53c-1f83-4701-8045-9dbbe7d70450 tempest-VolumesSnapshotTestJSON-1450209302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:47:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-897ad53c-1f83-4701-8045-9dbbe7d70450 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:47:22 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-897ad53c-1f83-4701-8045-9dbbe7d70450 tempest-VolumesSnapshotTestJSON-1450209302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:47:22 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-897ad53c-1f83-4701-8045-9dbbe7d70450 tempest-VolumesSnapshotTestJSON-1450209302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:47:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-897ad53c-1f83-4701-8045-9dbbe7d70450 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:47:22 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-897ad53c-1f83-4701-8045-9dbbe7d70450 tempest-VolumesSnapshotTestJSON-1450209302 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:47:22 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-897ad53c-1f83-4701-8045-9dbbe7d70450 tempest-VolumesSnapshotTestJSON-1450209302 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:47:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-897ad53c-1f83-4701-8045-9dbbe7d70450 tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:22 devstack sudo[90188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6 1073741824
Feb 28 04:47:22 devstack sudo[90188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:22 devstack sudo[90185]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b650dc65-e0f4-4ae5-9ce9-bf2e25e74f98 tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.426s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:22 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-b650dc65-e0f4-4ae5-9ce9-bf2e25e74f98 tempest-VolumesSnapshotTestJSON-1450209302 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:47:22 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-b650dc65-e0f4-4ae5-9ce9-bf2e25e74f98 tempest-VolumesSnapshotTestJSON-1450209302 None] Deleted volume successfully.
Feb 28 04:47:22 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-b650dc65-e0f4-4ae5-9ce9-bf2e25e74f98 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "cinder-7f143321-1a8b-493c-ae41-d891b2af1525-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:47:23 devstack sudo[90188]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-897ad53c-1f83-4701-8045-9dbbe7d70450 tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6 1073741824" returned: 0 in 0.687s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-897ad53c-1f83-4701-8045-9dbbe7d70450 tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:23 devstack sudo[90219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6
Feb 28 04:47:23 devstack sudo[90219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:23 devstack sudo[90219]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-897ad53c-1f83-4701-8045-9dbbe7d70450 tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6" returned: 0 in 0.484s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:23 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-897ad53c-1f83-4701-8045-9dbbe7d70450 tempest-VolumesSnapshotTestJSON-1450209302 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:47:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-897ad53c-1f83-4701-8045-9dbbe7d70450 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:47:23 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-897ad53c-1f83-4701-8045-9dbbe7d70450 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50c02ccd-724e-4102-903b-a292d95f2d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9696b1fc-48af-4933-8c8a-821e3ea124f6', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:47:23 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-897ad53c-1f83-4701-8045-9dbbe7d70450 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b39077ee-58e5-4ec4-8348-63e07ac29ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:47:23 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-897ad53c-1f83-4701-8045-9dbbe7d70450 tempest-VolumesSnapshotTestJSON-1450209302 None] Volume volume-9696b1fc-48af-4933-8c8a-821e3ea124f6 (9696b1fc-48af-4933-8c8a-821e3ea124f6): created successfully
Feb 28 04:47:23 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-897ad53c-1f83-4701-8045-9dbbe7d70450 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b39077ee-58e5-4ec4-8348-63e07ac29ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:47:23 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-897ad53c-1f83-4701-8045-9dbbe7d70450 tempest-VolumesSnapshotTestJSON-1450209302 None] Flow 'volume_create_manager' (ba9858d8-306f-4749-a64b-2a93d8525670) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:47:23 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-897ad53c-1f83-4701-8045-9dbbe7d70450 tempest-VolumesSnapshotTestJSON-1450209302 None] Created volume successfully.
Feb 28 04:47:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-514c079a-0b6f-41db-90c0-b14c03df9cdf tempest-VolumesSnapshotTestJSON-1450209302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:47:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-514c079a-0b6f-41db-90c0-b14c03df9cdf tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:47:24 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-514c079a-0b6f-41db-90c0-b14c03df9cdf tempest-VolumesSnapshotTestJSON-1450209302 None] Creating offline snapshot c8275c04-cb73-46e5-88c0-81ca9d5f3326 of volume 9696b1fc-48af-4933-8c8a-821e3ea124f6 {{(pid=84248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 04:47:24 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af1608e-3750-4012-b6a9-830f64b83865]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:47:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-514c079a-0b6f-41db-90c0-b14c03df9cdf tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:24 devstack cinder-volume[84248]: DEBUG oslo_service.periodic_task [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84248) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 28 04:47:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:47:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:47:24 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:47:24 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:47:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:47:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:24 devstack sudo[90224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:47:24 devstack sudo[90224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:24 devstack sudo[90223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6
Feb 28 04:47:24 devstack sudo[90223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:25 devstack sudo[90224]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.421s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:25 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:47:25 devstack sudo[90223]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-514c079a-0b6f-41db-90c0-b14c03df9cdf tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6" returned: 0 in 0.519s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-514c079a-0b6f-41db-90c0-b14c03df9cdf tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6.c8275c04-cb73-46e5-88c0-81ca9d5f3326 1G {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:25 devstack sudo[90231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6.c8275c04-cb73-46e5-88c0-81ca9d5f3326 1G
Feb 28 04:47:25 devstack sudo[90231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:25 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-cc25e87e-809a-4fdc-88da-791ccd5bd650 tempest-VolumesActionsTest-1301683667 None] Acquiring lock "cinder-59564c3e-78f0-4937-97da-b5b00dd152fa" by "attach_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:47:25 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-cc25e87e-809a-4fdc-88da-791ccd5bd650 tempest-VolumesActionsTest-1301683667 None] Lock "cinder-59564c3e-78f0-4937-97da-b5b00dd152fa" acquired by "attach_volume" :: waited 0.011s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:47:25 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-cc25e87e-809a-4fdc-88da-791ccd5bd650 tempest-VolumesActionsTest-1301683667 None] Attaching volume 59564c3e-78f0-4937-97da-b5b00dd152fa to instance 1b966a6e-4615-4b8f-bb1f-bcda2d70547e at mountpoint /dev/vdb on host None.
Feb 28 04:47:25 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-cc25e87e-809a-4fdc-88da-791ccd5bd650 tempest-VolumesActionsTest-1301683667 None] Attach volume completed successfully.
Feb 28 04:47:25 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-cc25e87e-809a-4fdc-88da-791ccd5bd650 tempest-VolumesActionsTest-1301683667 None] Lock "cinder-59564c3e-78f0-4937-97da-b5b00dd152fa" released by "attach_volume" :: held 0.057s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:47:25 devstack sudo[90231]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-514c079a-0b6f-41db-90c0-b14c03df9cdf tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6.c8275c04-cb73-46e5-88c0-81ca9d5f3326 1G" returned: 0 in 0.488s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-514c079a-0b6f-41db-90c0-b14c03df9cdf tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9696b1fc-48af-4933-8c8a-821e3ea124f6 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6.c8275c04-cb73-46e5-88c0-81ca9d5f3326 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:25 devstack sudo[90236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9696b1fc-48af-4933-8c8a-821e3ea124f6 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6.c8275c04-cb73-46e5-88c0-81ca9d5f3326
Feb 28 04:47:25 devstack sudo[90236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:25 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-5f96c54c-d602-4945-9ec5-6c954f91a84e tempest-VolumesActionsTest-1301683667 None] Acquiring lock "cinder-59564c3e-78f0-4937-97da-b5b00dd152fa-detach_volume" by "detach_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:47:25 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-5f96c54c-d602-4945-9ec5-6c954f91a84e tempest-VolumesActionsTest-1301683667 None] Lock "cinder-59564c3e-78f0-4937-97da-b5b00dd152fa-detach_volume" acquired by "detach_volume" :: waited 0.009s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:47:25 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-5f96c54c-d602-4945-9ec5-6c954f91a84e tempest-VolumesActionsTest-1301683667 None] Detaching volume 59564c3e-78f0-4937-97da-b5b00dd152fa from instance 1b966a6e-4615-4b8f-bb1f-bcda2d70547e.
Feb 28 04:47:25 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-5f96c54c-d602-4945-9ec5-6c954f91a84e tempest-VolumesActionsTest-1301683667 None] Detach volume completed successfully.
Feb 28 04:47:25 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-5f96c54c-d602-4945-9ec5-6c954f91a84e tempest-VolumesActionsTest-1301683667 None] Lock "cinder-59564c3e-78f0-4937-97da-b5b00dd152fa-detach_volume" released by "detach_volume" :: held 0.081s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:47:25 devstack sudo[90236]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-514c079a-0b6f-41db-90c0-b14c03df9cdf tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9696b1fc-48af-4933-8c8a-821e3ea124f6 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6.c8275c04-cb73-46e5-88c0-81ca9d5f3326" returned: 0 in 0.425s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:25 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-514c079a-0b6f-41db-90c0-b14c03df9cdf tempest-VolumesSnapshotTestJSON-1450209302 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6.c8275c04-cb73-46e5-88c0-81ca9d5f3326 is being set with open permissions: ugo+rw
Feb 28 04:47:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-514c079a-0b6f-41db-90c0-b14c03df9cdf tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6.c8275c04-cb73-46e5-88c0-81ca9d5f3326 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:26 devstack sudo[90241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6.c8275c04-cb73-46e5-88c0-81ca9d5f3326
Feb 28 04:47:26 devstack sudo[90241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:26 devstack sudo[90241]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-514c079a-0b6f-41db-90c0-b14c03df9cdf tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6.c8275c04-cb73-46e5-88c0-81ca9d5f3326" returned: 0 in 0.398s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-514c079a-0b6f-41db-90c0-b14c03df9cdf tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:26 devstack sudo[90244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6.info
Feb 28 04:47:26 devstack sudo[90244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:26 devstack sudo[90244]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-514c079a-0b6f-41db-90c0-b14c03df9cdf tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6.info" returned: 0 in 0.451s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:26 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-514c079a-0b6f-41db-90c0-b14c03df9cdf tempest-VolumesSnapshotTestJSON-1450209302 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6.info is being set with open permissions: ugo+rw
Feb 28 04:47:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-514c079a-0b6f-41db-90c0-b14c03df9cdf tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:26 devstack sudo[90247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6.info
Feb 28 04:47:26 devstack sudo[90247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:27 devstack sudo[90247]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:27 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-514c079a-0b6f-41db-90c0-b14c03df9cdf tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6.info" returned: 0 in 0.468s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:27 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-514c079a-0b6f-41db-90c0-b14c03df9cdf tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.816s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:47:27 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-514c079a-0b6f-41db-90c0-b14c03df9cdf tempest-VolumesSnapshotTestJSON-1450209302 None] Create snapshot completed successfully
Feb 28 04:47:27 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:47:28 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Flow 'volume_create_manager' (c1e7e182-3711-4b76-a0fb-fb32c15a2c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:47:28 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5883a6d2-21d3-4b74-b7c4-70610dc24427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:47:28 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5883a6d2-21d3-4b74-b7c4-70610dc24427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1728637722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd509a4-ebd2-473b-a538-ca512c1528e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38e49879b3b24d2d9b0adf1476729ddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c8275c04-cb73-46e5-88c0-81ca9d5f3326,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:47:28Z,use_quota=True,user_id='5ddc0b80823a4acc8f06430d30a63512',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:47:28 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c7a828f-8054-4af0-9ef2-d44c66ca3870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:47:28 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c7a828f-8054-4af0-9ef2-d44c66ca3870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:47:28 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6e3d5b5-9ab7-417a-bade-d7e2306055a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:47:28 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6e3d5b5-9ab7-417a-bade-d7e2306055a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6bd509a4-ebd2-473b-a538-ca512c1528e4', 'volume_name': 'volume-6bd509a4-ebd2-473b-a538-ca512c1528e4', 'volume_size': 1, 'snapshot_id': 'c8275c04-cb73-46e5-88c0-81ca9d5f3326'}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:47:28 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6726c111-5439-485b-b547-d048910d583c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:47:28 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6726c111-5439-485b-b547-d048910d583c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:47:28 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74110d02-e5e7-42ab-9d79-bcf4026d1b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:47:28 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Volume 6bd509a4-ebd2-473b-a538-ca512c1528e4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6bd509a4-ebd2-473b-a538-ca512c1528e4', 'volume_size': 1, 'snapshot_id': 'c8275c04-cb73-46e5-88c0-81ca9d5f3326'}
Feb 28 04:47:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:47:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:47:28 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Acquiring lock "cinder-quobyte-c8275c04-cb73-46e5-88c0-81ca9d5f3326-6bd509a4-ebd2-473b-a538-ca512c1528e4" by "_create_volume_from_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:47:28 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "cinder-quobyte-c8275c04-cb73-46e5-88c0-81ca9d5f3326-6bd509a4-ebd2-473b-a538-ca512c1528e4" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:47:28 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Creating volume 6bd509a4-ebd2-473b-a538-ca512c1528e4 from snapshot c8275c04-cb73-46e5-88c0-81ca9d5f3326 {{(pid=84248) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Feb 28 04:47:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:47:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:47:28 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:47:28 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:47:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:47:28 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:47:28 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Acquiring lock "cinder-quobyte-6bd509a4-ebd2-473b-a538-ca512c1528e4" by "_copy_volume_from_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:47:28 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "cinder-quobyte-6bd509a4-ebd2-473b-a538-ca512c1528e4" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:47:28 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] snapshot: c8275c04-cb73-46e5-88c0-81ca9d5f3326, volume: 6bd509a4-ebd2-473b-a538-ca512c1528e4,  {{(pid=84248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 28 04:47:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:47:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:47:28 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:47:28 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:47:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:47:28 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd756481-1b13-455e-a7b1-59c5ae702cdb]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:47:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6.c8275c04-cb73-46e5-88c0-81ca9d5f3326 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:28 devstack sudo[90285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6.c8275c04-cb73-46e5-88c0-81ca9d5f3326
Feb 28 04:47:28 devstack sudo[90285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:28 devstack sudo[90285]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6.c8275c04-cb73-46e5-88c0-81ca9d5f3326" returned: 0 in 0.472s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:28 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9696b1fc-48af-4933-8c8a-821e3ea124f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:47:28 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] will copy from snapshot at /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6 {{(pid=84248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 28 04:47:28 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Creating direct copy from snapshot {{(pid=84248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 28 04:47:28 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b11b974-6acb-4cad-9432-e6dcd41aad66]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:47:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:28 devstack sudo[90290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6
Feb 28 04:47:28 devstack sudo[90290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:29 devstack sudo[90290]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6" returned: 0 in 0.501s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:29 devstack cinder-volume[84248]: DEBUG cinder.utils [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Path /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6bd509a4-ebd2-473b-a538-ca512c1528e4 not found in is_blk_device check {{(pid=84248) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 28 04:47:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6bd509a4-ebd2-473b-a538-ca512c1528e4 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:29 devstack sudo[90295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6bd509a4-ebd2-473b-a538-ca512c1528e4
Feb 28 04:47:29 devstack sudo[90295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:31 devstack sudo[90295]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6bd509a4-ebd2-473b-a538-ca512c1528e4" returned: 0 in 2.101s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:31 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[b028a0fd-e953-4f91-a758-d905ffed8cc2]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:47:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:31 devstack sudo[90309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6
Feb 28 04:47:31 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:31 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6" returned: 0 in 0.585s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:31 devstack cinder-volume[84248]: DEBUG cinder.image.image_utils [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Image conversion details: src /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6, size 1024.00 MB, duration 2.10 sec, destination /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6bd509a4-ebd2-473b-a538-ca512c1528e4 {{(pid=84248) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 28 04:47:31 devstack cinder-volume[84248]: INFO cinder.image.image_utils [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Converted 1024.00 MB image at 487.04 MB/s
Feb 28 04:47:31 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6bd509a4-ebd2-473b-a538-ca512c1528e4 is being set with open permissions: ugo+rw
Feb 28 04:47:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6bd509a4-ebd2-473b-a538-ca512c1528e4 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:31 devstack sudo[90314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6bd509a4-ebd2-473b-a538-ca512c1528e4
Feb 28 04:47:31 devstack sudo[90314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:32 devstack sudo[90314]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6bd509a4-ebd2-473b-a538-ca512c1528e4" returned: 0 in 0.417s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:32 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "cinder-quobyte-6bd509a4-ebd2-473b-a538-ca512c1528e4" released by "_copy_volume_from_snapshot" :: held 4.134s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:47:32 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "cinder-quobyte-c8275c04-cb73-46e5-88c0-81ca9d5f3326-6bd509a4-ebd2-473b-a538-ca512c1528e4" released by "_create_volume_from_snapshot" :: held 4.150s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:47:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.159s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:47:32 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74110d02-e5e7-42ab-9d79-bcf4026d1b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bd509a4-ebd2-473b-a538-ca512c1528e4', 'volume_size': 1, 'snapshot_id': 'c8275c04-cb73-46e5-88c0-81ca9d5f3326'}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:47:32 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (607c6fce-2f71-4ea1-9a38-fbcf72999dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:47:32 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Volume volume-6bd509a4-ebd2-473b-a538-ca512c1528e4 (6bd509a4-ebd2-473b-a538-ca512c1528e4): created successfully
Feb 28 04:47:32 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (607c6fce-2f71-4ea1-9a38-fbcf72999dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:47:32 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Flow 'volume_create_manager' (c1e7e182-3711-4b76-a0fb-fb32c15a2c7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:47:32 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-03242c3c-7d18-401f-a9ee-cbcc868ca975 tempest-VolumesSnapshotTestJSON-1450209302 None] Created volume successfully.
Feb 28 04:47:33 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-b6927dee-0771-4ff0-a33f-298e667938a4 tempest-VolumesSnapshotTestJSON-1450209302 None] Acquiring lock "cinder-6bd509a4-ebd2-473b-a538-ca512c1528e4-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:47:33 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-b6927dee-0771-4ff0-a33f-298e667938a4 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "cinder-6bd509a4-ebd2-473b-a538-ca512c1528e4-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:47:33 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-b6927dee-0771-4ff0-a33f-298e667938a4 tempest-VolumesSnapshotTestJSON-1450209302 None] Acquiring lock "cinder-quobyte-6bd509a4-ebd2-473b-a538-ca512c1528e4" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:47:33 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-b6927dee-0771-4ff0-a33f-298e667938a4 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "cinder-quobyte-6bd509a4-ebd2-473b-a538-ca512c1528e4" acquired by "delete_volume" :: waited 0.014s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:47:33 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe8ce16-c976-4273-b1b0-0b01455cd92c]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:47:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b6927dee-0771-4ff0-a33f-298e667938a4 tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6bd509a4-ebd2-473b-a538-ca512c1528e4 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:33 devstack sudo[90319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6bd509a4-ebd2-473b-a538-ca512c1528e4
Feb 28 04:47:33 devstack sudo[90319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:33 devstack sudo[90319]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b6927dee-0771-4ff0-a33f-298e667938a4 tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6bd509a4-ebd2-473b-a538-ca512c1528e4" returned: 0 in 0.490s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b6927dee-0771-4ff0-a33f-298e667938a4 tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6bd509a4-ebd2-473b-a538-ca512c1528e4 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:34 devstack sudo[90324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6bd509a4-ebd2-473b-a538-ca512c1528e4
Feb 28 04:47:34 devstack sudo[90324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:34 devstack sudo[90324]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b6927dee-0771-4ff0-a33f-298e667938a4 tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6bd509a4-ebd2-473b-a538-ca512c1528e4" returned: 0 in 0.405s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:34 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-b6927dee-0771-4ff0-a33f-298e667938a4 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "cinder-quobyte-6bd509a4-ebd2-473b-a538-ca512c1528e4" released by "delete_volume" :: held 0.919s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:47:34 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-b6927dee-0771-4ff0-a33f-298e667938a4 tempest-VolumesSnapshotTestJSON-1450209302 None] Created reservations ['c3356144-7535-4783-b244-3247bc0c0d57', '47c78b48-67b8-4d35-b24f-cc981a75acda', '41a86ab1-70dc-4e96-a86a-8bc1bf6cd00c', '5f7038f5-1fac-4006-80e9-b1be41513732'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:47:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b6927dee-0771-4ff0-a33f-298e667938a4 tempest-VolumesSnapshotTestJSON-1450209302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:47:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b6927dee-0771-4ff0-a33f-298e667938a4 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:47:34 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-b6927dee-0771-4ff0-a33f-298e667938a4 tempest-VolumesSnapshotTestJSON-1450209302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:47:34 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-b6927dee-0771-4ff0-a33f-298e667938a4 tempest-VolumesSnapshotTestJSON-1450209302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:47:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b6927dee-0771-4ff0-a33f-298e667938a4 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:47:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b6927dee-0771-4ff0-a33f-298e667938a4 tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:34 devstack sudo[90327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:47:34 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:34 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-09881340-8795-4124-adc0-0eaba2129113 tempest-VolumesSnapshotTestJSON-1450209302 None] Acquiring lock "cinder-c8275c04-cb73-46e5-88c0-81ca9d5f3326-delete_snapshot" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:47:34 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-09881340-8795-4124-adc0-0eaba2129113 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "cinder-c8275c04-cb73-46e5-88c0-81ca9d5f3326-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:47:34 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-09881340-8795-4124-adc0-0eaba2129113 tempest-VolumesSnapshotTestJSON-1450209302 None] Acquiring lock "cinder-quobyte-9696b1fc-48af-4933-8c8a-821e3ea124f6" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:47:34 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-09881340-8795-4124-adc0-0eaba2129113 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "cinder-quobyte-9696b1fc-48af-4933-8c8a-821e3ea124f6" acquired by "delete_snapshot" :: waited 0.010s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:47:34 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-09881340-8795-4124-adc0-0eaba2129113 tempest-VolumesSnapshotTestJSON-1450209302 None] Acquiring lock "cinder-quobyte-c8275c04-cb73-46e5-88c0-81ca9d5f3326" by "_delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:47:34 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-09881340-8795-4124-adc0-0eaba2129113 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "cinder-quobyte-c8275c04-cb73-46e5-88c0-81ca9d5f3326" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:47:34 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-09881340-8795-4124-adc0-0eaba2129113 tempest-VolumesSnapshotTestJSON-1450209302 None] Deleting offline snapshot c8275c04-cb73-46e5-88c0-81ca9d5f3326 of volume 9696b1fc-48af-4933-8c8a-821e3ea124f6 {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 04:47:34 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-09881340-8795-4124-adc0-0eaba2129113 tempest-VolumesSnapshotTestJSON-1450209302 None] snapshot_file for this snap is: volume-9696b1fc-48af-4933-8c8a-821e3ea124f6.c8275c04-cb73-46e5-88c0-81ca9d5f3326 {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 04:47:34 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[5910bdd4-d7eb-4285-9d5a-126aaa36300a]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:47:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-09881340-8795-4124-adc0-0eaba2129113 tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6.c8275c04-cb73-46e5-88c0-81ca9d5f3326 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:34 devstack sudo[90329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6.c8275c04-cb73-46e5-88c0-81ca9d5f3326
Feb 28 04:47:34 devstack sudo[90329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:34 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b6927dee-0771-4ff0-a33f-298e667938a4 tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.432s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:34 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-b6927dee-0771-4ff0-a33f-298e667938a4 tempest-VolumesSnapshotTestJSON-1450209302 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:47:34 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-b6927dee-0771-4ff0-a33f-298e667938a4 tempest-VolumesSnapshotTestJSON-1450209302 None] Deleted volume successfully.
Feb 28 04:47:34 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-b6927dee-0771-4ff0-a33f-298e667938a4 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "cinder-6bd509a4-ebd2-473b-a538-ca512c1528e4-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:47:35 devstack sudo[90329]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-09881340-8795-4124-adc0-0eaba2129113 tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6.c8275c04-cb73-46e5-88c0-81ca9d5f3326" returned: 0 in 0.472s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:35 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-09881340-8795-4124-adc0-0eaba2129113 tempest-VolumesSnapshotTestJSON-1450209302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9696b1fc-48af-4933-8c8a-821e3ea124f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:47:35 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[e643182f-d9e1-4840-9c4b-47f555504b23]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:47:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-09881340-8795-4124-adc0-0eaba2129113 tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:35 devstack sudo[90335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6
Feb 28 04:47:35 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:35 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-09881340-8795-4124-adc0-0eaba2129113 tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6" returned: 0 in 0.475s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-09881340-8795-4124-adc0-0eaba2129113 tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6.c8275c04-cb73-46e5-88c0-81ca9d5f3326 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:35 devstack sudo[90340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6.c8275c04-cb73-46e5-88c0-81ca9d5f3326
Feb 28 04:47:35 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:36 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-09881340-8795-4124-adc0-0eaba2129113 tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6.c8275c04-cb73-46e5-88c0-81ca9d5f3326" returned: 0 in 0.442s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-09881340-8795-4124-adc0-0eaba2129113 tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6.c8275c04-cb73-46e5-88c0-81ca9d5f3326 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:36 devstack sudo[90345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6.c8275c04-cb73-46e5-88c0-81ca9d5f3326
Feb 28 04:47:36 devstack sudo[90345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:36 devstack sudo[90345]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-09881340-8795-4124-adc0-0eaba2129113 tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6.c8275c04-cb73-46e5-88c0-81ca9d5f3326" returned: 0 in 0.399s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:36 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-09881340-8795-4124-adc0-0eaba2129113 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "cinder-quobyte-c8275c04-cb73-46e5-88c0-81ca9d5f3326" released by "_delete_snapshot" :: held 1.838s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:47:36 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-09881340-8795-4124-adc0-0eaba2129113 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "cinder-quobyte-9696b1fc-48af-4933-8c8a-821e3ea124f6" released by "delete_snapshot" :: held 1.849s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:47:36 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-09881340-8795-4124-adc0-0eaba2129113 tempest-VolumesSnapshotTestJSON-1450209302 None] Created reservations ['6ee3d145-d3ac-4c35-a241-2a5bfb7fdfcd', 'bc38db6c-3029-4a04-a467-a743f59ba288', '4da84ea4-cc7a-4de6-86d9-57a00b230dda', '04f9dd78-aaa5-4fa0-aa07-3aa8f1ab8bba'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:47:36 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-09881340-8795-4124-adc0-0eaba2129113 tempest-VolumesSnapshotTestJSON-1450209302 None] Delete snapshot completed successfully.
Feb 28 04:47:36 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-09881340-8795-4124-adc0-0eaba2129113 tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "cinder-c8275c04-cb73-46e5-88c0-81ca9d5f3326-delete_snapshot" released by "delete_snapshot" :: held 1.935s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:47:36 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8899955b-acc3-4c4a-be57-a869cddb492b tempest-VolumesSnapshotTestJSON-1450209302 None] Acquiring lock "cinder-9696b1fc-48af-4933-8c8a-821e3ea124f6-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:47:36 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8899955b-acc3-4c4a-be57-a869cddb492b tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "cinder-9696b1fc-48af-4933-8c8a-821e3ea124f6-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:47:36 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8899955b-acc3-4c4a-be57-a869cddb492b tempest-VolumesSnapshotTestJSON-1450209302 None] Acquiring lock "cinder-quobyte-9696b1fc-48af-4933-8c8a-821e3ea124f6" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:47:36 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8899955b-acc3-4c4a-be57-a869cddb492b tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "cinder-quobyte-9696b1fc-48af-4933-8c8a-821e3ea124f6" acquired by "delete_volume" :: waited 0.017s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:47:36 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f63f9d-2016-4fbe-98c9-c91b5edac5f9]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:47:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8899955b-acc3-4c4a-be57-a869cddb492b tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:36 devstack sudo[90348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6
Feb 28 04:47:36 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:37 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8899955b-acc3-4c4a-be57-a869cddb492b tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6" returned: 0 in 0.451s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8899955b-acc3-4c4a-be57-a869cddb492b tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:37 devstack sudo[90353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6
Feb 28 04:47:37 devstack sudo[90353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:37 devstack sudo[90353]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8899955b-acc3-4c4a-be57-a869cddb492b tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9696b1fc-48af-4933-8c8a-821e3ea124f6" returned: 0 in 0.417s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:37 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8899955b-acc3-4c4a-be57-a869cddb492b tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "cinder-quobyte-9696b1fc-48af-4933-8c8a-821e3ea124f6" released by "delete_volume" :: held 0.901s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:47:37 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-8899955b-acc3-4c4a-be57-a869cddb492b tempest-VolumesSnapshotTestJSON-1450209302 None] Created reservations ['bbe5133b-2090-4ce3-9586-e45f586ea371', '53a4b187-91dd-47d9-b33d-3c543814c6b7', 'c1546533-5d59-41a7-b078-c1c2f01edb56', '577c8605-785e-4452-a163-be0693b93be9'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:47:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-8899955b-acc3-4c4a-be57-a869cddb492b tempest-VolumesSnapshotTestJSON-1450209302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:47:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-8899955b-acc3-4c4a-be57-a869cddb492b tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:47:37 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-8899955b-acc3-4c4a-be57-a869cddb492b tempest-VolumesSnapshotTestJSON-1450209302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:47:37 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-8899955b-acc3-4c4a-be57-a869cddb492b tempest-VolumesSnapshotTestJSON-1450209302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:47:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-8899955b-acc3-4c4a-be57-a869cddb492b tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:47:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8899955b-acc3-4c4a-be57-a869cddb492b tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:37 devstack sudo[90356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:47:37 devstack sudo[90356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:37 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-2fc25854-eccb-400f-9dad-3b8ff3989c8b tempest-VolumesSnapshotTestJSON-1450209302 None] Acquiring lock "cinder-8c46cc74-4a65-4ddf-adc2-04c040dc22c2-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:47:37 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-2fc25854-eccb-400f-9dad-3b8ff3989c8b tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "cinder-8c46cc74-4a65-4ddf-adc2-04c040dc22c2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:47:37 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-2fc25854-eccb-400f-9dad-3b8ff3989c8b tempest-VolumesSnapshotTestJSON-1450209302 None] Acquiring lock "cinder-quobyte-8c46cc74-4a65-4ddf-adc2-04c040dc22c2" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:47:37 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-2fc25854-eccb-400f-9dad-3b8ff3989c8b tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "cinder-quobyte-8c46cc74-4a65-4ddf-adc2-04c040dc22c2" acquired by "delete_volume" :: waited 0.009s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:47:37 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5cb422-cd8a-4ac9-addb-29266c457f6e]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:47:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-2fc25854-eccb-400f-9dad-3b8ff3989c8b tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:38 devstack sudo[90358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2
Feb 28 04:47:38 devstack sudo[90358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:38 devstack sudo[90356]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8899955b-acc3-4c4a-be57-a869cddb492b tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.440s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:38 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-8899955b-acc3-4c4a-be57-a869cddb492b tempest-VolumesSnapshotTestJSON-1450209302 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:47:38 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-8899955b-acc3-4c4a-be57-a869cddb492b tempest-VolumesSnapshotTestJSON-1450209302 None] Deleted volume successfully.
Feb 28 04:47:38 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8899955b-acc3-4c4a-be57-a869cddb492b tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "cinder-9696b1fc-48af-4933-8c8a-821e3ea124f6-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:47:38 devstack sudo[90358]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-2fc25854-eccb-400f-9dad-3b8ff3989c8b tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2" returned: 0 in 0.509s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-2fc25854-eccb-400f-9dad-3b8ff3989c8b tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:38 devstack sudo[90364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2
Feb 28 04:47:38 devstack sudo[90364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:38 devstack sudo[90364]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-2fc25854-eccb-400f-9dad-3b8ff3989c8b tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8c46cc74-4a65-4ddf-adc2-04c040dc22c2" returned: 0 in 0.457s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:38 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-2fc25854-eccb-400f-9dad-3b8ff3989c8b tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "cinder-quobyte-8c46cc74-4a65-4ddf-adc2-04c040dc22c2" released by "delete_volume" :: held 0.998s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:47:39 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-2fc25854-eccb-400f-9dad-3b8ff3989c8b tempest-VolumesSnapshotTestJSON-1450209302 None] Created reservations ['9d13d941-ac9a-488c-909f-1130741fa9df', 'a6f46660-9ec5-4212-b18c-20209711a814', 'aa8ac4c0-f7c0-4c7f-aac6-e52594867e97', '9d72ab0d-cdcf-457c-bb03-05bc3e799c33'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:47:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-2fc25854-eccb-400f-9dad-3b8ff3989c8b tempest-VolumesSnapshotTestJSON-1450209302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:47:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-2fc25854-eccb-400f-9dad-3b8ff3989c8b tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:47:39 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-2fc25854-eccb-400f-9dad-3b8ff3989c8b tempest-VolumesSnapshotTestJSON-1450209302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:47:39 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-2fc25854-eccb-400f-9dad-3b8ff3989c8b tempest-VolumesSnapshotTestJSON-1450209302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:47:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-2fc25854-eccb-400f-9dad-3b8ff3989c8b tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:47:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-2fc25854-eccb-400f-9dad-3b8ff3989c8b tempest-VolumesSnapshotTestJSON-1450209302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:39 devstack sudo[90368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:47:39 devstack sudo[90368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:39 devstack sudo[90368]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-2fc25854-eccb-400f-9dad-3b8ff3989c8b tempest-VolumesSnapshotTestJSON-1450209302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.417s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:39 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-2fc25854-eccb-400f-9dad-3b8ff3989c8b tempest-VolumesSnapshotTestJSON-1450209302 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:47:39 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-2fc25854-eccb-400f-9dad-3b8ff3989c8b tempest-VolumesSnapshotTestJSON-1450209302 None] Deleted volume successfully.
Feb 28 04:47:39 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-2fc25854-eccb-400f-9dad-3b8ff3989c8b tempest-VolumesSnapshotTestJSON-1450209302 None] Lock "cinder-8c46cc74-4a65-4ddf-adc2-04c040dc22c2-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:47:45 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-753c3c40-732c-4011-ad7f-7683a2cdb94a tempest-VolumesActionsTest-1301683667 None] Acquiring lock "cinder-59564c3e-78f0-4937-97da-b5b00dd152fa" by "attach_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:47:45 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-753c3c40-732c-4011-ad7f-7683a2cdb94a tempest-VolumesActionsTest-1301683667 None] Lock "cinder-59564c3e-78f0-4937-97da-b5b00dd152fa" acquired by "attach_volume" :: waited 0.009s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:47:46 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-753c3c40-732c-4011-ad7f-7683a2cdb94a tempest-VolumesActionsTest-1301683667 None] Attaching volume 59564c3e-78f0-4937-97da-b5b00dd152fa to instance 2eddd34b-8d1e-4868-ad68-1b6eb77d6dfc at mountpoint /dev/vdb on host None.
Feb 28 04:47:46 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-753c3c40-732c-4011-ad7f-7683a2cdb94a tempest-VolumesActionsTest-1301683667 None] Attach volume completed successfully.
Feb 28 04:47:46 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-753c3c40-732c-4011-ad7f-7683a2cdb94a tempest-VolumesActionsTest-1301683667 None] Lock "cinder-59564c3e-78f0-4937-97da-b5b00dd152fa" released by "attach_volume" :: held 0.066s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:47:46 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-cf069350-ba7e-4b42-b190-eacc86b8bf0f tempest-VolumesActionsTest-1301683667 None] Acquiring lock "cinder-59564c3e-78f0-4937-97da-b5b00dd152fa-detach_volume" by "detach_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:47:46 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-cf069350-ba7e-4b42-b190-eacc86b8bf0f tempest-VolumesActionsTest-1301683667 None] Lock "cinder-59564c3e-78f0-4937-97da-b5b00dd152fa-detach_volume" acquired by "detach_volume" :: waited 0.008s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:47:46 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-cf069350-ba7e-4b42-b190-eacc86b8bf0f tempest-VolumesActionsTest-1301683667 None] Detaching volume 59564c3e-78f0-4937-97da-b5b00dd152fa from instance 2eddd34b-8d1e-4868-ad68-1b6eb77d6dfc.
Feb 28 04:47:46 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-cf069350-ba7e-4b42-b190-eacc86b8bf0f tempest-VolumesActionsTest-1301683667 None] Detach volume completed successfully.
Feb 28 04:47:46 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-cf069350-ba7e-4b42-b190-eacc86b8bf0f tempest-VolumesActionsTest-1301683667 None] Lock "cinder-59564c3e-78f0-4937-97da-b5b00dd152fa-detach_volume" released by "detach_volume" :: held 0.032s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:47:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-4c2fbe66-40b5-494f-b14a-856bc4c466e3 tempest-VolumesActionsTest-1301683667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:47:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-4c2fbe66-40b5-494f-b14a-856bc4c466e3 tempest-VolumesActionsTest-1301683667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:47:54 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ed9da8-feac-45e0-a2b8-640f66493441]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:47:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4c2fbe66-40b5-494f-b14a-856bc4c466e3 tempest-VolumesActionsTest-1301683667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59564c3e-78f0-4937-97da-b5b00dd152fa {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:54 devstack sudo[90452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59564c3e-78f0-4937-97da-b5b00dd152fa
Feb 28 04:47:54 devstack sudo[90452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:55 devstack sudo[90452]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4c2fbe66-40b5-494f-b14a-856bc4c466e3 tempest-VolumesActionsTest-1301683667 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59564c3e-78f0-4937-97da-b5b00dd152fa" returned: 0 in 0.511s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:55 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[b449dbad-5541-4a4c-85f1-4eaaab203db3]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:47:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4c2fbe66-40b5-494f-b14a-856bc4c466e3 tempest-VolumesActionsTest-1301683667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59564c3e-78f0-4937-97da-b5b00dd152fa {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:55 devstack sudo[90457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59564c3e-78f0-4937-97da-b5b00dd152fa
Feb 28 04:47:55 devstack sudo[90457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:55 devstack sudo[90457]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4c2fbe66-40b5-494f-b14a-856bc4c466e3 tempest-VolumesActionsTest-1301683667 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59564c3e-78f0-4937-97da-b5b00dd152fa" returned: 0 in 0.534s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4c2fbe66-40b5-494f-b14a-856bc4c466e3 tempest-VolumesActionsTest-1301683667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59564c3e-78f0-4937-97da-b5b00dd152fa /opt/stack/data/cinder/conversion/59564c3e-78f0-4937-97da-b5b00dd152fa.temp_image.f4a8bcd0-49db-4b57-8370-331a173aed30rgq2dzf2.img {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:55 devstack sudo[90462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59564c3e-78f0-4937-97da-b5b00dd152fa /opt/stack/data/cinder/conversion/59564c3e-78f0-4937-97da-b5b00dd152fa.temp_image.f4a8bcd0-49db-4b57-8370-331a173aed30rgq2dzf2.img
Feb 28 04:47:55 devstack sudo[90462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:56 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d9409ba-3930-4c13-ad40-85e194583e0c tempest-SnapshotDependencyTests-1442825553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:47:56 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5d9409ba-3930-4c13-ad40-85e194583e0c tempest-SnapshotDependencyTests-1442825553 None] Flow 'volume_create_manager' (76d63cb6-2106-4b00-b8ec-f78658791216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:47:56 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5d9409ba-3930-4c13-ad40-85e194583e0c tempest-SnapshotDependencyTests-1442825553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c746cb9-a35f-47bf-9fc5-2cc1f35f9859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:47:56 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5d9409ba-3930-4c13-ad40-85e194583e0c tempest-SnapshotDependencyTests-1442825553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c746cb9-a35f-47bf-9fc5-2cc1f35f9859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:47:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-859597045',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20a6e5cf-1928-4f96-9887-b326d5acb542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4809b613daa4db8b984255994829060',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:47:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:47:56Z,use_quota=True,user_id='ea7bf656a1294e09916bd50076f784e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:47:56 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5d9409ba-3930-4c13-ad40-85e194583e0c tempest-SnapshotDependencyTests-1442825553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c3f0263-259a-483f-94bc-772aa8773317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:47:56 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5d9409ba-3930-4c13-ad40-85e194583e0c tempest-SnapshotDependencyTests-1442825553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c3f0263-259a-483f-94bc-772aa8773317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:47:56 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5d9409ba-3930-4c13-ad40-85e194583e0c tempest-SnapshotDependencyTests-1442825553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76047949-0463-4f6e-9123-ae6d451127c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:47:56 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5d9409ba-3930-4c13-ad40-85e194583e0c tempest-SnapshotDependencyTests-1442825553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76047949-0463-4f6e-9123-ae6d451127c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20a6e5cf-1928-4f96-9887-b326d5acb542', 'volume_name': 'volume-20a6e5cf-1928-4f96-9887-b326d5acb542', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:47:56 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5d9409ba-3930-4c13-ad40-85e194583e0c tempest-SnapshotDependencyTests-1442825553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (255a93fc-9846-4b7d-b82a-be924a687fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:47:56 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5d9409ba-3930-4c13-ad40-85e194583e0c tempest-SnapshotDependencyTests-1442825553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (255a93fc-9846-4b7d-b82a-be924a687fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:47:56 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5d9409ba-3930-4c13-ad40-85e194583e0c tempest-SnapshotDependencyTests-1442825553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d05f694-811f-4b61-9c88-a0ddb5b4d0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:47:56 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-5d9409ba-3930-4c13-ad40-85e194583e0c tempest-SnapshotDependencyTests-1442825553 None] Volume 20a6e5cf-1928-4f96-9887-b326d5acb542: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20a6e5cf-1928-4f96-9887-b326d5acb542', 'volume_size': 1}
Feb 28 04:47:56 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5d9409ba-3930-4c13-ad40-85e194583e0c tempest-SnapshotDependencyTests-1442825553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:47:57 devstack sudo[90462]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:57 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4c2fbe66-40b5-494f-b14a-856bc4c466e3 tempest-VolumesActionsTest-1301683667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59564c3e-78f0-4937-97da-b5b00dd152fa /opt/stack/data/cinder/conversion/59564c3e-78f0-4937-97da-b5b00dd152fa.temp_image.f4a8bcd0-49db-4b57-8370-331a173aed30rgq2dzf2.img" returned: 0 in 2.119s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:58 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f8ef1b-e804-4801-a9ce-7ff75c6f2035]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:47:58 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4c2fbe66-40b5-494f-b14a-856bc4c466e3 tempest-VolumesActionsTest-1301683667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59564c3e-78f0-4937-97da-b5b00dd152fa {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:47:58 devstack sudo[90474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59564c3e-78f0-4937-97da-b5b00dd152fa
Feb 28 04:47:58 devstack sudo[90474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:47:58 devstack sudo[90474]: pam_unix(sudo:session): session closed for user root
Feb 28 04:47:58 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4c2fbe66-40b5-494f-b14a-856bc4c466e3 tempest-VolumesActionsTest-1301683667 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59564c3e-78f0-4937-97da-b5b00dd152fa" returned: 0 in 0.596s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:47:58 devstack cinder-volume[84248]: DEBUG cinder.image.image_utils [None req-4c2fbe66-40b5-494f-b14a-856bc4c466e3 tempest-VolumesActionsTest-1301683667 None] Image conversion details: src /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59564c3e-78f0-4937-97da-b5b00dd152fa, size 1024.00 MB, duration 2.12 sec, destination /opt/stack/data/cinder/conversion/59564c3e-78f0-4937-97da-b5b00dd152fa.temp_image.f4a8bcd0-49db-4b57-8370-331a173aed30rgq2dzf2.img {{(pid=84248) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 28 04:47:58 devstack cinder-volume[84248]: INFO cinder.image.image_utils [None req-4c2fbe66-40b5-494f-b14a-856bc4c466e3 tempest-VolumesActionsTest-1301683667 None] Converted 1024.00 MB image at 483.12 MB/s
Feb 28 04:47:58 devstack cinder-volume[84248]: DEBUG cinder.image.image_utils [None req-4c2fbe66-40b5-494f-b14a-856bc4c466e3 tempest-VolumesActionsTest-1301683667 None] f4a8bcd0-49db-4b57-8370-331a173aed30 was raw, no need to convert to raw {{(pid=84248) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}}
Feb 28 04:48:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-4c2fbe66-40b5-494f-b14a-856bc4c466e3 tempest-VolumesActionsTest-1301683667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.417s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:48:08 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-4c2fbe66-40b5-494f-b14a-856bc4c466e3 tempest-VolumesActionsTest-1301683667 None] Uploaded volume to glance image-id: f4a8bcd0-49db-4b57-8370-331a173aed30. {{(pid=84248) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Feb 28 04:48:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5d9409ba-3930-4c13-ad40-85e194583e0c tempest-SnapshotDependencyTests-1442825553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.169s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:48:08 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-5d9409ba-3930-4c13-ad40-85e194583e0c tempest-SnapshotDependencyTests-1442825553 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:47:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-859597045',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20a6e5cf-1928-4f96-9887-b326d5acb542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4809b613daa4db8b984255994829060',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:47:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:47:56Z,use_quota=True,user_id='ea7bf656a1294e09916bd50076f784e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:48:08 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-5d9409ba-3930-4c13-ad40-85e194583e0c tempest-SnapshotDependencyTests-1442825553 None] Creating volume 20a6e5cf-1928-4f96-9887-b326d5acb542 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:48:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5d9409ba-3930-4c13-ad40-85e194583e0c tempest-SnapshotDependencyTests-1442825553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:48:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5d9409ba-3930-4c13-ad40-85e194583e0c tempest-SnapshotDependencyTests-1442825553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:48:08 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-5d9409ba-3930-4c13-ad40-85e194583e0c tempest-SnapshotDependencyTests-1442825553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:48:08 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-5d9409ba-3930-4c13-ad40-85e194583e0c tempest-SnapshotDependencyTests-1442825553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:48:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5d9409ba-3930-4c13-ad40-85e194583e0c tempest-SnapshotDependencyTests-1442825553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:48:08 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-5d9409ba-3930-4c13-ad40-85e194583e0c tempest-SnapshotDependencyTests-1442825553 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:48:08 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-5d9409ba-3930-4c13-ad40-85e194583e0c tempest-SnapshotDependencyTests-1442825553 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:48:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5d9409ba-3930-4c13-ad40-85e194583e0c tempest-SnapshotDependencyTests-1442825553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:08 devstack cinder-volume[84248]: DEBUG dbcounter [-] [84248] Writing DB stats cinder:DELETE=12,cinder:SELECT=103,cinder:INSERT=35,cinder:UPDATE=130 {{(pid=84248) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 04:48:08 devstack sudo[90480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542 1073741824
Feb 28 04:48:08 devstack sudo[90480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:08 devstack cinder-volume[84248]: DEBUG dbcounter [-] [84248] Writing DB stats cinder:SELECT=102,cinder:INSERT=31,cinder:UPDATE=131,cinder:DELETE=9 {{(pid=84248) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 04:48:08 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-4c2fbe66-40b5-494f-b14a-856bc4c466e3 tempest-VolumesActionsTest-1301683667 None] Copy volume to image completed successfully.
Feb 28 04:48:08 devstack sudo[90480]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5d9409ba-3930-4c13-ad40-85e194583e0c tempest-SnapshotDependencyTests-1442825553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542 1073741824" returned: 0 in 0.476s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5d9409ba-3930-4c13-ad40-85e194583e0c tempest-SnapshotDependencyTests-1442825553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:08 devstack sudo[90485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542
Feb 28 04:48:08 devstack sudo[90485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:09 devstack sudo[90485]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:09 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5d9409ba-3930-4c13-ad40-85e194583e0c tempest-SnapshotDependencyTests-1442825553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542" returned: 0 in 0.385s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:09 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-5d9409ba-3930-4c13-ad40-85e194583e0c tempest-SnapshotDependencyTests-1442825553 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:48:09 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5d9409ba-3930-4c13-ad40-85e194583e0c tempest-SnapshotDependencyTests-1442825553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:48:09 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5d9409ba-3930-4c13-ad40-85e194583e0c tempest-SnapshotDependencyTests-1442825553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d05f694-811f-4b61-9c88-a0ddb5b4d0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20a6e5cf-1928-4f96-9887-b326d5acb542', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:48:09 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5d9409ba-3930-4c13-ad40-85e194583e0c tempest-SnapshotDependencyTests-1442825553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c49f1995-6ebb-444c-86ac-f5222ba7305b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:48:09 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-5d9409ba-3930-4c13-ad40-85e194583e0c tempest-SnapshotDependencyTests-1442825553 None] Volume volume-20a6e5cf-1928-4f96-9887-b326d5acb542 (20a6e5cf-1928-4f96-9887-b326d5acb542): created successfully
Feb 28 04:48:09 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5d9409ba-3930-4c13-ad40-85e194583e0c tempest-SnapshotDependencyTests-1442825553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c49f1995-6ebb-444c-86ac-f5222ba7305b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:48:09 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5d9409ba-3930-4c13-ad40-85e194583e0c tempest-SnapshotDependencyTests-1442825553 None] Flow 'volume_create_manager' (76d63cb6-2106-4b00-b8ec-f78658791216) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:48:09 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-5d9409ba-3930-4c13-ad40-85e194583e0c tempest-SnapshotDependencyTests-1442825553 None] Created volume successfully.
Feb 28 04:48:09 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-9d99830a-d17f-458a-b8fe-7e5c4da8af4d tempest-VolumesActionsTest-1301683667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:48:09 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-9d99830a-d17f-458a-b8fe-7e5c4da8af4d tempest-VolumesActionsTest-1301683667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:48:09 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ce4317-79af-4059-a4e2-8c5064a0b268]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:48:09 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9d99830a-d17f-458a-b8fe-7e5c4da8af4d tempest-VolumesActionsTest-1301683667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59564c3e-78f0-4937-97da-b5b00dd152fa {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:09 devstack sudo[90489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59564c3e-78f0-4937-97da-b5b00dd152fa
Feb 28 04:48:09 devstack sudo[90489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:09 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b6e837a0-b556-4820-86f0-9f07cdb5fc0a tempest-SnapshotDependencyTests-1442825553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:48:10 devstack sudo[90489]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9d99830a-d17f-458a-b8fe-7e5c4da8af4d tempest-VolumesActionsTest-1301683667 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59564c3e-78f0-4937-97da-b5b00dd152fa" returned: 0 in 0.469s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:10 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12d7d5f-5a5c-45f8-ad6b-feb74f1e809a]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:48:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9d99830a-d17f-458a-b8fe-7e5c4da8af4d tempest-VolumesActionsTest-1301683667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59564c3e-78f0-4937-97da-b5b00dd152fa {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:10 devstack sudo[90494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59564c3e-78f0-4937-97da-b5b00dd152fa
Feb 28 04:48:10 devstack sudo[90494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:10 devstack sudo[90494]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9d99830a-d17f-458a-b8fe-7e5c4da8af4d tempest-VolumesActionsTest-1301683667 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59564c3e-78f0-4937-97da-b5b00dd152fa" returned: 0 in 0.466s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9d99830a-d17f-458a-b8fe-7e5c4da8af4d tempest-VolumesActionsTest-1301683667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59564c3e-78f0-4937-97da-b5b00dd152fa /opt/stack/data/cinder/conversion/59564c3e-78f0-4937-97da-b5b00dd152fa.temp_image.0e65509c-cc08-4847-9529-4d2c95d7007a7y61s5wr.img {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:10 devstack sudo[90499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59564c3e-78f0-4937-97da-b5b00dd152fa /opt/stack/data/cinder/conversion/59564c3e-78f0-4937-97da-b5b00dd152fa.temp_image.0e65509c-cc08-4847-9529-4d2c95d7007a7y61s5wr.img
Feb 28 04:48:10 devstack sudo[90499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:12 devstack sudo[90499]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9d99830a-d17f-458a-b8fe-7e5c4da8af4d tempest-VolumesActionsTest-1301683667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59564c3e-78f0-4937-97da-b5b00dd152fa /opt/stack/data/cinder/conversion/59564c3e-78f0-4937-97da-b5b00dd152fa.temp_image.0e65509c-cc08-4847-9529-4d2c95d7007a7y61s5wr.img" returned: 0 in 1.795s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:12 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab6da9f-47dd-4a2a-962d-d44cd7275020]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:48:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9d99830a-d17f-458a-b8fe-7e5c4da8af4d tempest-VolumesActionsTest-1301683667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59564c3e-78f0-4937-97da-b5b00dd152fa {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:12 devstack sudo[90511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59564c3e-78f0-4937-97da-b5b00dd152fa
Feb 28 04:48:12 devstack sudo[90511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:13 devstack sudo[90511]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9d99830a-d17f-458a-b8fe-7e5c4da8af4d tempest-VolumesActionsTest-1301683667 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59564c3e-78f0-4937-97da-b5b00dd152fa" returned: 0 in 0.585s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:13 devstack cinder-volume[84248]: DEBUG cinder.image.image_utils [None req-9d99830a-d17f-458a-b8fe-7e5c4da8af4d tempest-VolumesActionsTest-1301683667 None] Image conversion details: src /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59564c3e-78f0-4937-97da-b5b00dd152fa, size 1024.00 MB, duration 1.80 sec, destination /opt/stack/data/cinder/conversion/59564c3e-78f0-4937-97da-b5b00dd152fa.temp_image.0e65509c-cc08-4847-9529-4d2c95d7007a7y61s5wr.img {{(pid=84248) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 28 04:48:13 devstack cinder-volume[84248]: INFO cinder.image.image_utils [None req-9d99830a-d17f-458a-b8fe-7e5c4da8af4d tempest-VolumesActionsTest-1301683667 None] Converted 1024.00 MB image at 569.82 MB/s
Feb 28 04:48:13 devstack cinder-volume[84248]: DEBUG cinder.image.image_utils [None req-9d99830a-d17f-458a-b8fe-7e5c4da8af4d tempest-VolumesActionsTest-1301683667 None] 0e65509c-cc08-4847-9529-4d2c95d7007a was raw, converting to qcow2 {{(pid=84248) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}}
Feb 28 04:48:13 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4879256-d454-43fd-8214-ab42a4202bff]: (4, 'raw') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:48:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9d99830a-d17f-458a-b8fe-7e5c4da8af4d tempest-VolumesActionsTest-1301683667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/59564c3e-78f0-4937-97da-b5b00dd152fa.temp_image.0e65509c-cc08-4847-9529-4d2c95d7007a7y61s5wr.img {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:13 devstack sudo[90516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/59564c3e-78f0-4937-97da-b5b00dd152fa.temp_image.0e65509c-cc08-4847-9529-4d2c95d7007a7y61s5wr.img
Feb 28 04:48:13 devstack sudo[90516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:13 devstack sudo[90516]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9d99830a-d17f-458a-b8fe-7e5c4da8af4d tempest-VolumesActionsTest-1301683667 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/59564c3e-78f0-4937-97da-b5b00dd152fa.temp_image.0e65509c-cc08-4847-9529-4d2c95d7007a7y61s5wr.img" returned: 0 in 0.446s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9d99830a-d17f-458a-b8fe-7e5c4da8af4d tempest-VolumesActionsTest-1301683667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/59564c3e-78f0-4937-97da-b5b00dd152fa.temp_image.0e65509c-cc08-4847-9529-4d2c95d7007a7y61s5wr.img {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:13 devstack sudo[90520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/59564c3e-78f0-4937-97da-b5b00dd152fa.temp_image.0e65509c-cc08-4847-9529-4d2c95d7007a7y61s5wr.img
Feb 28 04:48:13 devstack sudo[90520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:14 devstack sudo[90520]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9d99830a-d17f-458a-b8fe-7e5c4da8af4d tempest-VolumesActionsTest-1301683667 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/59564c3e-78f0-4937-97da-b5b00dd152fa.temp_image.0e65509c-cc08-4847-9529-4d2c95d7007a7y61s5wr.img" returned: 1 in 0.469s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9d99830a-d17f-458a-b8fe-7e5c4da8af4d tempest-VolumesActionsTest-1301683667 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/59564c3e-78f0-4937-97da-b5b00dd152fa.temp_image.0e65509c-cc08-4847-9529-4d2c95d7007a7y61s5wr.img' failed. Not Retrying. {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 28 04:48:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9d99830a-d17f-458a-b8fe-7e5c4da8af4d tempest-VolumesActionsTest-1301683667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/59564c3e-78f0-4937-97da-b5b00dd152fa.temp_image.0e65509c-cc08-4847-9529-4d2c95d7007a7y61s5wr.img /opt/stack/data/cinder/conversion/vol_upload_gakv94d5 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:14 devstack sudo[90525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/59564c3e-78f0-4937-97da-b5b00dd152fa.temp_image.0e65509c-cc08-4847-9529-4d2c95d7007a7y61s5wr.img /opt/stack/data/cinder/conversion/vol_upload_gakv94d5
Feb 28 04:48:14 devstack sudo[90525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:14 devstack sudo[90525]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9d99830a-d17f-458a-b8fe-7e5c4da8af4d tempest-VolumesActionsTest-1301683667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/59564c3e-78f0-4937-97da-b5b00dd152fa.temp_image.0e65509c-cc08-4847-9529-4d2c95d7007a7y61s5wr.img /opt/stack/data/cinder/conversion/vol_upload_gakv94d5" returned: 0 in 0.416s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:14 devstack cinder-volume[84248]: DEBUG cinder.image.image_utils [None req-9d99830a-d17f-458a-b8fe-7e5c4da8af4d tempest-VolumesActionsTest-1301683667 None] Image conversion details: src /opt/stack/data/cinder/conversion/59564c3e-78f0-4937-97da-b5b00dd152fa.temp_image.0e65509c-cc08-4847-9529-4d2c95d7007a7y61s5wr.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_gakv94d5 {{(pid=84248) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 28 04:48:14 devstack cinder-volume[84248]: INFO cinder.image.image_utils [None req-9d99830a-d17f-458a-b8fe-7e5c4da8af4d tempest-VolumesActionsTest-1301683667 None] Converted 1024.00 MB image at 1024.00 MB/s
Feb 28 04:48:14 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[57781a1b-6ab3-4c4a-ab7d-74bb8e7eb351]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:48:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9d99830a-d17f-458a-b8fe-7e5c4da8af4d tempest-VolumesActionsTest-1301683667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_gakv94d5 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:14 devstack sudo[90530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_gakv94d5
Feb 28 04:48:14 devstack sudo[90530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:14 devstack sudo[90530]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9d99830a-d17f-458a-b8fe-7e5c4da8af4d tempest-VolumesActionsTest-1301683667 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_gakv94d5" returned: 0 in 0.458s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-9d99830a-d17f-458a-b8fe-7e5c4da8af4d tempest-VolumesActionsTest-1301683667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 5.949s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:48:15 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9d99830a-d17f-458a-b8fe-7e5c4da8af4d tempest-VolumesActionsTest-1301683667 None] Uploaded volume to glance image-id: 0e65509c-cc08-4847-9529-4d2c95d7007a. {{(pid=84248) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Feb 28 04:48:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b6e837a0-b556-4820-86f0-9f07cdb5fc0a tempest-SnapshotDependencyTests-1442825553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.712s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:48:15 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-b6e837a0-b556-4820-86f0-9f07cdb5fc0a tempest-SnapshotDependencyTests-1442825553 None] Creating offline snapshot a0bd8d37-5f34-4cbb-b927-f5ba81de7ff4 of volume 20a6e5cf-1928-4f96-9887-b326d5acb542 {{(pid=84248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 04:48:15 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-9d99830a-d17f-458a-b8fe-7e5c4da8af4d tempest-VolumesActionsTest-1301683667 None] Copy volume to image completed successfully.
Feb 28 04:48:15 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[437433c6-640c-4cfd-bccc-4bbcea4e79fd]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:48:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b6e837a0-b556-4820-86f0-9f07cdb5fc0a tempest-SnapshotDependencyTests-1442825553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:15 devstack sudo[90535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542
Feb 28 04:48:15 devstack sudo[90535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:16 devstack sudo[90535]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b6e837a0-b556-4820-86f0-9f07cdb5fc0a tempest-SnapshotDependencyTests-1442825553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542" returned: 0 in 0.465s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b6e837a0-b556-4820-86f0-9f07cdb5fc0a tempest-SnapshotDependencyTests-1442825553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542.a0bd8d37-5f34-4cbb-b927-f5ba81de7ff4 1G {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:16 devstack sudo[90540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542.a0bd8d37-5f34-4cbb-b927-f5ba81de7ff4 1G
Feb 28 04:48:16 devstack sudo[90540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:16 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-93b0625d-2068-4f8e-8970-bc25ede3026e tempest-VolumesActionsTest-1301683667 None] Acquiring lock "cinder-59564c3e-78f0-4937-97da-b5b00dd152fa-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:48:16 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-93b0625d-2068-4f8e-8970-bc25ede3026e tempest-VolumesActionsTest-1301683667 None] Lock "cinder-59564c3e-78f0-4937-97da-b5b00dd152fa-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:48:16 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-93b0625d-2068-4f8e-8970-bc25ede3026e tempest-VolumesActionsTest-1301683667 None] Acquiring lock "cinder-quobyte-59564c3e-78f0-4937-97da-b5b00dd152fa" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:48:16 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-93b0625d-2068-4f8e-8970-bc25ede3026e tempest-VolumesActionsTest-1301683667 None] Lock "cinder-quobyte-59564c3e-78f0-4937-97da-b5b00dd152fa" acquired by "delete_volume" :: waited 0.006s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:48:16 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f32f5b-61ae-4ea1-8a53-a37551e827d9]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:48:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-93b0625d-2068-4f8e-8970-bc25ede3026e tempest-VolumesActionsTest-1301683667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59564c3e-78f0-4937-97da-b5b00dd152fa {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:16 devstack sudo[90542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59564c3e-78f0-4937-97da-b5b00dd152fa
Feb 28 04:48:16 devstack sudo[90542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:16 devstack sudo[90540]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b6e837a0-b556-4820-86f0-9f07cdb5fc0a tempest-SnapshotDependencyTests-1442825553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542.a0bd8d37-5f34-4cbb-b927-f5ba81de7ff4 1G" returned: 0 in 0.474s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b6e837a0-b556-4820-86f0-9f07cdb5fc0a tempest-SnapshotDependencyTests-1442825553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20a6e5cf-1928-4f96-9887-b326d5acb542 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542.a0bd8d37-5f34-4cbb-b927-f5ba81de7ff4 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:16 devstack sudo[90547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20a6e5cf-1928-4f96-9887-b326d5acb542 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542.a0bd8d37-5f34-4cbb-b927-f5ba81de7ff4
Feb 28 04:48:16 devstack sudo[90547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:16 devstack sudo[90542]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-93b0625d-2068-4f8e-8970-bc25ede3026e tempest-VolumesActionsTest-1301683667 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59564c3e-78f0-4937-97da-b5b00dd152fa" returned: 0 in 0.474s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-93b0625d-2068-4f8e-8970-bc25ede3026e tempest-VolumesActionsTest-1301683667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59564c3e-78f0-4937-97da-b5b00dd152fa {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:16 devstack sudo[90552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59564c3e-78f0-4937-97da-b5b00dd152fa
Feb 28 04:48:16 devstack sudo[90552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:17 devstack sudo[90547]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b6e837a0-b556-4820-86f0-9f07cdb5fc0a tempest-SnapshotDependencyTests-1442825553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20a6e5cf-1928-4f96-9887-b326d5acb542 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542.a0bd8d37-5f34-4cbb-b927-f5ba81de7ff4" returned: 0 in 0.419s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:17 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-b6e837a0-b556-4820-86f0-9f07cdb5fc0a tempest-SnapshotDependencyTests-1442825553 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542.a0bd8d37-5f34-4cbb-b927-f5ba81de7ff4 is being set with open permissions: ugo+rw
Feb 28 04:48:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b6e837a0-b556-4820-86f0-9f07cdb5fc0a tempest-SnapshotDependencyTests-1442825553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542.a0bd8d37-5f34-4cbb-b927-f5ba81de7ff4 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:17 devstack sudo[90557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542.a0bd8d37-5f34-4cbb-b927-f5ba81de7ff4
Feb 28 04:48:17 devstack sudo[90557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:17 devstack sudo[90552]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-93b0625d-2068-4f8e-8970-bc25ede3026e tempest-VolumesActionsTest-1301683667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-59564c3e-78f0-4937-97da-b5b00dd152fa" returned: 0 in 0.399s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:17 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-93b0625d-2068-4f8e-8970-bc25ede3026e tempest-VolumesActionsTest-1301683667 None] Lock "cinder-quobyte-59564c3e-78f0-4937-97da-b5b00dd152fa" released by "delete_volume" :: held 0.905s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:48:17 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-93b0625d-2068-4f8e-8970-bc25ede3026e tempest-VolumesActionsTest-1301683667 None] Created reservations ['a615aca5-3746-43e3-a902-eafb58f74013', '7f96045e-8348-45ee-b920-1ef6ab1e39fd', '9ab31989-dcd0-49cb-9c60-a5a134d644a5', '1b85b27c-d94c-488d-a3cd-dd1114ae3dbb'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:48:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-93b0625d-2068-4f8e-8970-bc25ede3026e tempest-VolumesActionsTest-1301683667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:48:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-93b0625d-2068-4f8e-8970-bc25ede3026e tempest-VolumesActionsTest-1301683667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:48:17 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-93b0625d-2068-4f8e-8970-bc25ede3026e tempest-VolumesActionsTest-1301683667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:48:17 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-93b0625d-2068-4f8e-8970-bc25ede3026e tempest-VolumesActionsTest-1301683667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:48:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-93b0625d-2068-4f8e-8970-bc25ede3026e tempest-VolumesActionsTest-1301683667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:48:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-93b0625d-2068-4f8e-8970-bc25ede3026e tempest-VolumesActionsTest-1301683667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:17 devstack sudo[90560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:48:17 devstack sudo[90560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:17 devstack sudo[90557]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b6e837a0-b556-4820-86f0-9f07cdb5fc0a tempest-SnapshotDependencyTests-1442825553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542.a0bd8d37-5f34-4cbb-b927-f5ba81de7ff4" returned: 0 in 0.440s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b6e837a0-b556-4820-86f0-9f07cdb5fc0a tempest-SnapshotDependencyTests-1442825553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:17 devstack sudo[90563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542.info
Feb 28 04:48:17 devstack sudo[90563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:17 devstack sudo[90560]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-93b0625d-2068-4f8e-8970-bc25ede3026e tempest-VolumesActionsTest-1301683667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.451s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:17 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-93b0625d-2068-4f8e-8970-bc25ede3026e tempest-VolumesActionsTest-1301683667 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:48:17 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-93b0625d-2068-4f8e-8970-bc25ede3026e tempest-VolumesActionsTest-1301683667 None] Deleted volume successfully.
Feb 28 04:48:17 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-93b0625d-2068-4f8e-8970-bc25ede3026e tempest-VolumesActionsTest-1301683667 None] Lock "cinder-59564c3e-78f0-4937-97da-b5b00dd152fa-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:48:18 devstack sudo[90563]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b6e837a0-b556-4820-86f0-9f07cdb5fc0a tempest-SnapshotDependencyTests-1442825553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542.info" returned: 0 in 0.452s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:18 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-b6e837a0-b556-4820-86f0-9f07cdb5fc0a tempest-SnapshotDependencyTests-1442825553 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542.info is being set with open permissions: ugo+rw
Feb 28 04:48:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b6e837a0-b556-4820-86f0-9f07cdb5fc0a tempest-SnapshotDependencyTests-1442825553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:18 devstack sudo[90599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542.info
Feb 28 04:48:18 devstack sudo[90599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:18 devstack sudo[90599]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b6e837a0-b556-4820-86f0-9f07cdb5fc0a tempest-SnapshotDependencyTests-1442825553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542.info" returned: 0 in 0.469s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b6e837a0-b556-4820-86f0-9f07cdb5fc0a tempest-SnapshotDependencyTests-1442825553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.801s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:48:18 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-b6e837a0-b556-4820-86f0-9f07cdb5fc0a tempest-SnapshotDependencyTests-1442825553 None] Create snapshot completed successfully
Feb 28 04:48:19 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:48:19 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Flow 'volume_create_manager' (c4615ae2-f90d-4844-ae1f-035a86141f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:48:19 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2db95841-c19e-49c4-908b-b790a07a2441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:48:19 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2db95841-c19e-49c4-908b-b790a07a2441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e33f7a9-b5bb-496b-bc44-6b574bf224b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4809b613daa4db8b984255994829060',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a0bd8d37-5f34-4cbb-b927-f5ba81de7ff4,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:48:20Z,use_quota=True,user_id='ea7bf656a1294e09916bd50076f784e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:48:19 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eb7b757-099e-417b-9db3-561d5675a769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:48:19 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eb7b757-099e-417b-9db3-561d5675a769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:48:19 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0885726-2898-4bcf-9362-b7821afa6384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:48:19 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0885726-2898-4bcf-9362-b7821afa6384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9e33f7a9-b5bb-496b-bc44-6b574bf224b5', 'volume_name': 'volume-9e33f7a9-b5bb-496b-bc44-6b574bf224b5', 'volume_size': 1, 'snapshot_id': 'a0bd8d37-5f34-4cbb-b927-f5ba81de7ff4'}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:48:19 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b002e4b-953d-4259-96da-f5f2ef53cba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:48:19 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b002e4b-953d-4259-96da-f5f2ef53cba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:48:19 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6961f5a2-a600-46fb-bdff-872bbcac834b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:48:19 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Volume 9e33f7a9-b5bb-496b-bc44-6b574bf224b5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9e33f7a9-b5bb-496b-bc44-6b574bf224b5', 'volume_size': 1, 'snapshot_id': 'a0bd8d37-5f34-4cbb-b927-f5ba81de7ff4'}
Feb 28 04:48:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:48:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:48:19 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Acquiring lock "cinder-quobyte-a0bd8d37-5f34-4cbb-b927-f5ba81de7ff4-9e33f7a9-b5bb-496b-bc44-6b574bf224b5" by "_create_volume_from_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:48:19 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Lock "cinder-quobyte-a0bd8d37-5f34-4cbb-b927-f5ba81de7ff4-9e33f7a9-b5bb-496b-bc44-6b574bf224b5" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:48:19 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Creating volume 9e33f7a9-b5bb-496b-bc44-6b574bf224b5 from snapshot a0bd8d37-5f34-4cbb-b927-f5ba81de7ff4 {{(pid=84248) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Feb 28 04:48:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:48:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:48:19 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:48:19 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:48:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:48:19 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:48:19 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Acquiring lock "cinder-quobyte-9e33f7a9-b5bb-496b-bc44-6b574bf224b5" by "_copy_volume_from_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:48:19 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Lock "cinder-quobyte-9e33f7a9-b5bb-496b-bc44-6b574bf224b5" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:48:19 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] snapshot: a0bd8d37-5f34-4cbb-b927-f5ba81de7ff4, volume: 9e33f7a9-b5bb-496b-bc44-6b574bf224b5,  {{(pid=84248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 28 04:48:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:48:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:48:19 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:48:19 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:48:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:48:19 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[624189fe-e317-492d-a8db-c7e96b894d48]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:48:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542.a0bd8d37-5f34-4cbb-b927-f5ba81de7ff4 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:19 devstack sudo[90612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542.a0bd8d37-5f34-4cbb-b927-f5ba81de7ff4
Feb 28 04:48:19 devstack sudo[90612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:20 devstack sudo[90612]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542.a0bd8d37-5f34-4cbb-b927-f5ba81de7ff4" returned: 0 in 0.534s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:20 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20a6e5cf-1928-4f96-9887-b326d5acb542(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:48:20 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] will copy from snapshot at /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542 {{(pid=84248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 28 04:48:20 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Creating direct copy from snapshot {{(pid=84248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 28 04:48:20 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d98c3a-12e2-4d42-81e1-58ea3c7ab5c8]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:48:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:20 devstack sudo[90618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542
Feb 28 04:48:20 devstack sudo[90618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:20 devstack sudo[90618]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542" returned: 0 in 0.543s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:20 devstack cinder-volume[84248]: DEBUG cinder.utils [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Path /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9e33f7a9-b5bb-496b-bc44-6b574bf224b5 not found in is_blk_device check {{(pid=84248) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 28 04:48:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9e33f7a9-b5bb-496b-bc44-6b574bf224b5 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:20 devstack sudo[90623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9e33f7a9-b5bb-496b-bc44-6b574bf224b5
Feb 28 04:48:20 devstack sudo[90623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:21 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dc268fc-8160-4c08-b788-2f3bad05aaec tempest-VolumesListTestJSON-467788868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:48:21 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-8dc268fc-8160-4c08-b788-2f3bad05aaec tempest-VolumesListTestJSON-467788868 None] Flow 'volume_create_manager' (911b6c2c-aaf8-43f1-80c6-98f2176e4a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:48:21 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-8dc268fc-8160-4c08-b788-2f3bad05aaec tempest-VolumesListTestJSON-467788868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4870e0f8-0e46-4fdc-879a-c8759b790099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:48:21 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-8dc268fc-8160-4c08-b788-2f3bad05aaec tempest-VolumesListTestJSON-467788868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4870e0f8-0e46-4fdc-879a-c8759b790099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-655685893',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a5b9028-e4be-4b4a-a9c8-3c39285cb4fd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6abb7da4bab4465089554ec23475de58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:48:22Z,use_quota=True,user_id='f521ad76529b4ea99ac5091be3dc631f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:48:21 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-8dc268fc-8160-4c08-b788-2f3bad05aaec tempest-VolumesListTestJSON-467788868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4342d601-c554-49e2-aceb-957781afbfa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:48:21 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-8dc268fc-8160-4c08-b788-2f3bad05aaec tempest-VolumesListTestJSON-467788868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4342d601-c554-49e2-aceb-957781afbfa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:48:21 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-8dc268fc-8160-4c08-b788-2f3bad05aaec tempest-VolumesListTestJSON-467788868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d67ec479-5357-481e-9cc3-d2cdd1ffcb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:48:21 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-8dc268fc-8160-4c08-b788-2f3bad05aaec tempest-VolumesListTestJSON-467788868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d67ec479-5357-481e-9cc3-d2cdd1ffcb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a5b9028-e4be-4b4a-a9c8-3c39285cb4fd', 'volume_name': 'volume-1a5b9028-e4be-4b4a-a9c8-3c39285cb4fd', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:48:21 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-8dc268fc-8160-4c08-b788-2f3bad05aaec tempest-VolumesListTestJSON-467788868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc3e9567-bce5-452d-8ca4-e461510cccea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:48:21 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-8dc268fc-8160-4c08-b788-2f3bad05aaec tempest-VolumesListTestJSON-467788868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc3e9567-bce5-452d-8ca4-e461510cccea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:48:21 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-8dc268fc-8160-4c08-b788-2f3bad05aaec tempest-VolumesListTestJSON-467788868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f7ceed4-7609-47c4-835b-d30c2e7239f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:48:21 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-8dc268fc-8160-4c08-b788-2f3bad05aaec tempest-VolumesListTestJSON-467788868 None] Volume 1a5b9028-e4be-4b4a-a9c8-3c39285cb4fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a5b9028-e4be-4b4a-a9c8-3c39285cb4fd', 'volume_size': 1}
Feb 28 04:48:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-8dc268fc-8160-4c08-b788-2f3bad05aaec tempest-VolumesListTestJSON-467788868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:48:22 devstack sudo[90623]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9e33f7a9-b5bb-496b-bc44-6b574bf224b5" returned: 0 in 2.090s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:22 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a93bedd-3f01-40a4-bc71-304cefebfdf1]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:48:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:23 devstack sudo[90635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542
Feb 28 04:48:23 devstack sudo[90635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:23 devstack sudo[90635]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542" returned: 0 in 0.597s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:23 devstack cinder-volume[84248]: DEBUG cinder.image.image_utils [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Image conversion details: src /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542, size 1024.00 MB, duration 2.09 sec, destination /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9e33f7a9-b5bb-496b-bc44-6b574bf224b5 {{(pid=84248) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 28 04:48:23 devstack cinder-volume[84248]: INFO cinder.image.image_utils [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Converted 1024.00 MB image at 489.79 MB/s
Feb 28 04:48:23 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9e33f7a9-b5bb-496b-bc44-6b574bf224b5 is being set with open permissions: ugo+rw
Feb 28 04:48:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9e33f7a9-b5bb-496b-bc44-6b574bf224b5 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:23 devstack sudo[90640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9e33f7a9-b5bb-496b-bc44-6b574bf224b5
Feb 28 04:48:23 devstack sudo[90640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:23 devstack sudo[90640]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9e33f7a9-b5bb-496b-bc44-6b574bf224b5" returned: 0 in 0.400s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:23 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Lock "cinder-quobyte-9e33f7a9-b5bb-496b-bc44-6b574bf224b5" released by "_copy_volume_from_snapshot" :: held 4.218s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:48:23 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Lock "cinder-quobyte-a0bd8d37-5f34-4cbb-b927-f5ba81de7ff4-9e33f7a9-b5bb-496b-bc44-6b574bf224b5" released by "_create_volume_from_snapshot" :: held 4.235s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:48:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.244s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:48:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-8dc268fc-8160-4c08-b788-2f3bad05aaec tempest-VolumesListTestJSON-467788868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.035s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:48:23 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-8dc268fc-8160-4c08-b788-2f3bad05aaec tempest-VolumesListTestJSON-467788868 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-655685893',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a5b9028-e4be-4b4a-a9c8-3c39285cb4fd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6abb7da4bab4465089554ec23475de58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:48:22Z,use_quota=True,user_id='f521ad76529b4ea99ac5091be3dc631f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:48:23 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-8dc268fc-8160-4c08-b788-2f3bad05aaec tempest-VolumesListTestJSON-467788868 None] Creating volume 1a5b9028-e4be-4b4a-a9c8-3c39285cb4fd {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:48:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-8dc268fc-8160-4c08-b788-2f3bad05aaec tempest-VolumesListTestJSON-467788868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:48:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-8dc268fc-8160-4c08-b788-2f3bad05aaec tempest-VolumesListTestJSON-467788868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:48:23 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-8dc268fc-8160-4c08-b788-2f3bad05aaec tempest-VolumesListTestJSON-467788868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:48:23 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-8dc268fc-8160-4c08-b788-2f3bad05aaec tempest-VolumesListTestJSON-467788868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:48:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-8dc268fc-8160-4c08-b788-2f3bad05aaec tempest-VolumesListTestJSON-467788868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:48:23 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-8dc268fc-8160-4c08-b788-2f3bad05aaec tempest-VolumesListTestJSON-467788868 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:48:23 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-8dc268fc-8160-4c08-b788-2f3bad05aaec tempest-VolumesListTestJSON-467788868 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:48:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8dc268fc-8160-4c08-b788-2f3bad05aaec tempest-VolumesListTestJSON-467788868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1a5b9028-e4be-4b4a-a9c8-3c39285cb4fd 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:23 devstack sudo[90643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1a5b9028-e4be-4b4a-a9c8-3c39285cb4fd 1073741824
Feb 28 04:48:23 devstack sudo[90643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:23 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6961f5a2-a600-46fb-bdff-872bbcac834b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e33f7a9-b5bb-496b-bc44-6b574bf224b5', 'volume_size': 1, 'snapshot_id': 'a0bd8d37-5f34-4cbb-b927-f5ba81de7ff4'}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:48:23 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a67403e-a331-4396-a215-019444cdeea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:48:24 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Volume volume-9e33f7a9-b5bb-496b-bc44-6b574bf224b5 (9e33f7a9-b5bb-496b-bc44-6b574bf224b5): created successfully
Feb 28 04:48:24 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a67403e-a331-4396-a215-019444cdeea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:48:24 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Flow 'volume_create_manager' (c4615ae2-f90d-4844-ae1f-035a86141f9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:48:24 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-79a34955-8551-4479-a2a8-a8aefab881b7 tempest-SnapshotDependencyTests-1442825553 None] Created volume successfully.
Feb 28 04:48:24 devstack sudo[90643]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8dc268fc-8160-4c08-b788-2f3bad05aaec tempest-VolumesListTestJSON-467788868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1a5b9028-e4be-4b4a-a9c8-3c39285cb4fd 1073741824" returned: 0 in 0.458s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8dc268fc-8160-4c08-b788-2f3bad05aaec tempest-VolumesListTestJSON-467788868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1a5b9028-e4be-4b4a-a9c8-3c39285cb4fd {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:24 devstack sudo[90648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1a5b9028-e4be-4b4a-a9c8-3c39285cb4fd
Feb 28 04:48:24 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:24 devstack cinder-volume[84248]: DEBUG oslo_service.periodic_task [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84248) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 28 04:48:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:48:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:48:24 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:48:24 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:48:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:48:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:24 devstack sudo[90650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:48:24 devstack sudo[90650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:24 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8dc268fc-8160-4c08-b788-2f3bad05aaec tempest-VolumesListTestJSON-467788868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1a5b9028-e4be-4b4a-a9c8-3c39285cb4fd" returned: 0 in 0.408s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:24 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-8dc268fc-8160-4c08-b788-2f3bad05aaec tempest-VolumesListTestJSON-467788868 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:48:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-8dc268fc-8160-4c08-b788-2f3bad05aaec tempest-VolumesListTestJSON-467788868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:48:24 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-8dc268fc-8160-4c08-b788-2f3bad05aaec tempest-VolumesListTestJSON-467788868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f7ceed4-7609-47c4-835b-d30c2e7239f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a5b9028-e4be-4b4a-a9c8-3c39285cb4fd', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:48:24 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-8dc268fc-8160-4c08-b788-2f3bad05aaec tempest-VolumesListTestJSON-467788868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1df3fbb-d80d-4db1-b58f-66e49c35f6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:48:24 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-8dc268fc-8160-4c08-b788-2f3bad05aaec tempest-VolumesListTestJSON-467788868 None] Volume volume-1a5b9028-e4be-4b4a-a9c8-3c39285cb4fd (1a5b9028-e4be-4b4a-a9c8-3c39285cb4fd): created successfully
Feb 28 04:48:24 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-8dc268fc-8160-4c08-b788-2f3bad05aaec tempest-VolumesListTestJSON-467788868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1df3fbb-d80d-4db1-b58f-66e49c35f6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:48:24 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-8dc268fc-8160-4c08-b788-2f3bad05aaec tempest-VolumesListTestJSON-467788868 None] Flow 'volume_create_manager' (911b6c2c-aaf8-43f1-80c6-98f2176e4a48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:48:24 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-8dc268fc-8160-4c08-b788-2f3bad05aaec tempest-VolumesListTestJSON-467788868 None] Created volume successfully.
Feb 28 04:48:25 devstack sudo[90650]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.426s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:25 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:48:25 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-dbd6a054-1a5d-4f1a-b09d-bbf4bc9fda7c tempest-SnapshotDependencyTests-1442825553 None] Acquiring lock "cinder-a0bd8d37-5f34-4cbb-b927-f5ba81de7ff4-delete_snapshot" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:48:25 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-dbd6a054-1a5d-4f1a-b09d-bbf4bc9fda7c tempest-SnapshotDependencyTests-1442825553 None] Lock "cinder-a0bd8d37-5f34-4cbb-b927-f5ba81de7ff4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:48:25 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-dbd6a054-1a5d-4f1a-b09d-bbf4bc9fda7c tempest-SnapshotDependencyTests-1442825553 None] Acquiring lock "cinder-quobyte-20a6e5cf-1928-4f96-9887-b326d5acb542" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:48:25 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-dbd6a054-1a5d-4f1a-b09d-bbf4bc9fda7c tempest-SnapshotDependencyTests-1442825553 None] Lock "cinder-quobyte-20a6e5cf-1928-4f96-9887-b326d5acb542" acquired by "delete_snapshot" :: waited 0.012s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:48:25 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-dbd6a054-1a5d-4f1a-b09d-bbf4bc9fda7c tempest-SnapshotDependencyTests-1442825553 None] Acquiring lock "cinder-quobyte-a0bd8d37-5f34-4cbb-b927-f5ba81de7ff4" by "_delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:48:25 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-dbd6a054-1a5d-4f1a-b09d-bbf4bc9fda7c tempest-SnapshotDependencyTests-1442825553 None] Lock "cinder-quobyte-a0bd8d37-5f34-4cbb-b927-f5ba81de7ff4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:48:25 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-dbd6a054-1a5d-4f1a-b09d-bbf4bc9fda7c tempest-SnapshotDependencyTests-1442825553 None] Deleting offline snapshot a0bd8d37-5f34-4cbb-b927-f5ba81de7ff4 of volume 20a6e5cf-1928-4f96-9887-b326d5acb542 {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 04:48:25 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-dbd6a054-1a5d-4f1a-b09d-bbf4bc9fda7c tempest-SnapshotDependencyTests-1442825553 None] snapshot_file for this snap is: volume-20a6e5cf-1928-4f96-9887-b326d5acb542.a0bd8d37-5f34-4cbb-b927-f5ba81de7ff4 {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 04:48:25 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fd60bc-5e00-4ee2-896e-766d4ed315f6]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:48:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dbd6a054-1a5d-4f1a-b09d-bbf4bc9fda7c tempest-SnapshotDependencyTests-1442825553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542.a0bd8d37-5f34-4cbb-b927-f5ba81de7ff4 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:25 devstack sudo[90654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542.a0bd8d37-5f34-4cbb-b927-f5ba81de7ff4
Feb 28 04:48:25 devstack sudo[90654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:25 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c7845b5-0642-4181-98bb-da30f36ae8f5 tempest-VolumesListTestJSON-467788868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:48:25 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-1c7845b5-0642-4181-98bb-da30f36ae8f5 tempest-VolumesListTestJSON-467788868 None] Flow 'volume_create_manager' (dd1fa412-1c18-4678-a243-c8f7734a027c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:48:25 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-1c7845b5-0642-4181-98bb-da30f36ae8f5 tempest-VolumesListTestJSON-467788868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a8e24d0-3192-4e8b-8bc7-2445e7da6cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:48:25 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-1c7845b5-0642-4181-98bb-da30f36ae8f5 tempest-VolumesListTestJSON-467788868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a8e24d0-3192-4e8b-8bc7-2445e7da6cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-842547991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1ecbe86-d39e-4997-97d7-7a7b968f467d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6abb7da4bab4465089554ec23475de58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:48:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:48:25Z,use_quota=True,user_id='f521ad76529b4ea99ac5091be3dc631f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:48:25 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-1c7845b5-0642-4181-98bb-da30f36ae8f5 tempest-VolumesListTestJSON-467788868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71067b20-03cd-4843-9e79-395bb7969a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:48:25 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-1c7845b5-0642-4181-98bb-da30f36ae8f5 tempest-VolumesListTestJSON-467788868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71067b20-03cd-4843-9e79-395bb7969a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:48:25 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-1c7845b5-0642-4181-98bb-da30f36ae8f5 tempest-VolumesListTestJSON-467788868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ca00986-56ea-40ed-a051-5f20c4474d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:48:25 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-1c7845b5-0642-4181-98bb-da30f36ae8f5 tempest-VolumesListTestJSON-467788868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ca00986-56ea-40ed-a051-5f20c4474d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1ecbe86-d39e-4997-97d7-7a7b968f467d', 'volume_name': 'volume-e1ecbe86-d39e-4997-97d7-7a7b968f467d', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:48:25 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-1c7845b5-0642-4181-98bb-da30f36ae8f5 tempest-VolumesListTestJSON-467788868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fc4fbca-50a0-4641-9b27-e9192e69912b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:48:25 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-1c7845b5-0642-4181-98bb-da30f36ae8f5 tempest-VolumesListTestJSON-467788868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fc4fbca-50a0-4641-9b27-e9192e69912b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:48:25 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-1c7845b5-0642-4181-98bb-da30f36ae8f5 tempest-VolumesListTestJSON-467788868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acc1d03c-d7b6-4514-b317-6defacc43004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:48:25 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-1c7845b5-0642-4181-98bb-da30f36ae8f5 tempest-VolumesListTestJSON-467788868 None] Volume e1ecbe86-d39e-4997-97d7-7a7b968f467d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1ecbe86-d39e-4997-97d7-7a7b968f467d', 'volume_size': 1}
Feb 28 04:48:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-1c7845b5-0642-4181-98bb-da30f36ae8f5 tempest-VolumesListTestJSON-467788868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:48:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-1c7845b5-0642-4181-98bb-da30f36ae8f5 tempest-VolumesListTestJSON-467788868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:48:25 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-1c7845b5-0642-4181-98bb-da30f36ae8f5 tempest-VolumesListTestJSON-467788868 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-842547991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1ecbe86-d39e-4997-97d7-7a7b968f467d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6abb7da4bab4465089554ec23475de58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:48:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:48:25Z,use_quota=True,user_id='f521ad76529b4ea99ac5091be3dc631f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:48:25 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-1c7845b5-0642-4181-98bb-da30f36ae8f5 tempest-VolumesListTestJSON-467788868 None] Creating volume e1ecbe86-d39e-4997-97d7-7a7b968f467d {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:48:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-1c7845b5-0642-4181-98bb-da30f36ae8f5 tempest-VolumesListTestJSON-467788868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:48:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-1c7845b5-0642-4181-98bb-da30f36ae8f5 tempest-VolumesListTestJSON-467788868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:48:25 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-1c7845b5-0642-4181-98bb-da30f36ae8f5 tempest-VolumesListTestJSON-467788868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:48:25 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-1c7845b5-0642-4181-98bb-da30f36ae8f5 tempest-VolumesListTestJSON-467788868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:48:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-1c7845b5-0642-4181-98bb-da30f36ae8f5 tempest-VolumesListTestJSON-467788868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:48:25 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-1c7845b5-0642-4181-98bb-da30f36ae8f5 tempest-VolumesListTestJSON-467788868 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:48:25 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-1c7845b5-0642-4181-98bb-da30f36ae8f5 tempest-VolumesListTestJSON-467788868 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:48:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1c7845b5-0642-4181-98bb-da30f36ae8f5 tempest-VolumesListTestJSON-467788868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e1ecbe86-d39e-4997-97d7-7a7b968f467d 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:25 devstack sudo[90656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e1ecbe86-d39e-4997-97d7-7a7b968f467d 1073741824
Feb 28 04:48:25 devstack sudo[90656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:25 devstack sudo[90654]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dbd6a054-1a5d-4f1a-b09d-bbf4bc9fda7c tempest-SnapshotDependencyTests-1442825553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542.a0bd8d37-5f34-4cbb-b927-f5ba81de7ff4" returned: 0 in 0.497s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:25 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-dbd6a054-1a5d-4f1a-b09d-bbf4bc9fda7c tempest-SnapshotDependencyTests-1442825553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20a6e5cf-1928-4f96-9887-b326d5acb542(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:48:25 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf4682d-817f-4f9e-9fe2-833024c53ae3]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:48:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dbd6a054-1a5d-4f1a-b09d-bbf4bc9fda7c tempest-SnapshotDependencyTests-1442825553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:25 devstack sudo[90661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542
Feb 28 04:48:25 devstack sudo[90661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:25 devstack sudo[90656]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1c7845b5-0642-4181-98bb-da30f36ae8f5 tempest-VolumesListTestJSON-467788868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e1ecbe86-d39e-4997-97d7-7a7b968f467d 1073741824" returned: 0 in 0.490s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1c7845b5-0642-4181-98bb-da30f36ae8f5 tempest-VolumesListTestJSON-467788868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e1ecbe86-d39e-4997-97d7-7a7b968f467d {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:25 devstack sudo[90666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e1ecbe86-d39e-4997-97d7-7a7b968f467d
Feb 28 04:48:25 devstack sudo[90666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:26 devstack sudo[90661]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dbd6a054-1a5d-4f1a-b09d-bbf4bc9fda7c tempest-SnapshotDependencyTests-1442825553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542" returned: 0 in 0.524s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dbd6a054-1a5d-4f1a-b09d-bbf4bc9fda7c tempest-SnapshotDependencyTests-1442825553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542.a0bd8d37-5f34-4cbb-b927-f5ba81de7ff4 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:26 devstack sudo[90672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542.a0bd8d37-5f34-4cbb-b927-f5ba81de7ff4
Feb 28 04:48:26 devstack sudo[90672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:26 devstack sudo[90666]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1c7845b5-0642-4181-98bb-da30f36ae8f5 tempest-VolumesListTestJSON-467788868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e1ecbe86-d39e-4997-97d7-7a7b968f467d" returned: 0 in 0.463s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:26 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-1c7845b5-0642-4181-98bb-da30f36ae8f5 tempest-VolumesListTestJSON-467788868 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:48:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-1c7845b5-0642-4181-98bb-da30f36ae8f5 tempest-VolumesListTestJSON-467788868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:48:26 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-1c7845b5-0642-4181-98bb-da30f36ae8f5 tempest-VolumesListTestJSON-467788868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acc1d03c-d7b6-4514-b317-6defacc43004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1ecbe86-d39e-4997-97d7-7a7b968f467d', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:48:26 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-1c7845b5-0642-4181-98bb-da30f36ae8f5 tempest-VolumesListTestJSON-467788868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddca282d-1cc6-4e70-b430-91c1b6b8656b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:48:26 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-1c7845b5-0642-4181-98bb-da30f36ae8f5 tempest-VolumesListTestJSON-467788868 None] Volume volume-e1ecbe86-d39e-4997-97d7-7a7b968f467d (e1ecbe86-d39e-4997-97d7-7a7b968f467d): created successfully
Feb 28 04:48:26 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-1c7845b5-0642-4181-98bb-da30f36ae8f5 tempest-VolumesListTestJSON-467788868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddca282d-1cc6-4e70-b430-91c1b6b8656b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:48:26 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-1c7845b5-0642-4181-98bb-da30f36ae8f5 tempest-VolumesListTestJSON-467788868 None] Flow 'volume_create_manager' (dd1fa412-1c18-4678-a243-c8f7734a027c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:48:26 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-1c7845b5-0642-4181-98bb-da30f36ae8f5 tempest-VolumesListTestJSON-467788868 None] Created volume successfully.
Feb 28 04:48:26 devstack sudo[90672]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dbd6a054-1a5d-4f1a-b09d-bbf4bc9fda7c tempest-SnapshotDependencyTests-1442825553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542.a0bd8d37-5f34-4cbb-b927-f5ba81de7ff4" returned: 0 in 0.473s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dbd6a054-1a5d-4f1a-b09d-bbf4bc9fda7c tempest-SnapshotDependencyTests-1442825553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542.a0bd8d37-5f34-4cbb-b927-f5ba81de7ff4 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:26 devstack sudo[90678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542.a0bd8d37-5f34-4cbb-b927-f5ba81de7ff4
Feb 28 04:48:26 devstack sudo[90678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:27 devstack sudo[90678]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:27 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dbd6a054-1a5d-4f1a-b09d-bbf4bc9fda7c tempest-SnapshotDependencyTests-1442825553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542.a0bd8d37-5f34-4cbb-b927-f5ba81de7ff4" returned: 0 in 0.411s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:27 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-dbd6a054-1a5d-4f1a-b09d-bbf4bc9fda7c tempest-SnapshotDependencyTests-1442825553 None] Lock "cinder-quobyte-a0bd8d37-5f34-4cbb-b927-f5ba81de7ff4" released by "_delete_snapshot" :: held 1.956s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:48:27 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-dbd6a054-1a5d-4f1a-b09d-bbf4bc9fda7c tempest-SnapshotDependencyTests-1442825553 None] Lock "cinder-quobyte-20a6e5cf-1928-4f96-9887-b326d5acb542" released by "delete_snapshot" :: held 1.975s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:48:27 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-dbd6a054-1a5d-4f1a-b09d-bbf4bc9fda7c tempest-SnapshotDependencyTests-1442825553 None] Created reservations ['df8112ed-8efc-4032-8e26-b0ff1d432c93', '23009d4c-a211-4e02-8ad1-fde40d933fc3', '3e6b57e8-498b-4123-a6da-ede0d8986e99', '70f63d06-2c31-4316-a2b1-e9cc5dc99119'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:48:27 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-dbd6a054-1a5d-4f1a-b09d-bbf4bc9fda7c tempest-SnapshotDependencyTests-1442825553 None] Delete snapshot completed successfully.
Feb 28 04:48:27 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-dbd6a054-1a5d-4f1a-b09d-bbf4bc9fda7c tempest-SnapshotDependencyTests-1442825553 None] Lock "cinder-a0bd8d37-5f34-4cbb-b927-f5ba81de7ff4-delete_snapshot" released by "delete_snapshot" :: held 2.071s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:48:27 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f01306fd-aa0a-4897-a52f-1a581b6d196d tempest-SnapshotDependencyTests-1442825553 None] Acquiring lock "cinder-20a6e5cf-1928-4f96-9887-b326d5acb542-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:48:27 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f01306fd-aa0a-4897-a52f-1a581b6d196d tempest-SnapshotDependencyTests-1442825553 None] Lock "cinder-20a6e5cf-1928-4f96-9887-b326d5acb542-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:48:27 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f01306fd-aa0a-4897-a52f-1a581b6d196d tempest-SnapshotDependencyTests-1442825553 None] Acquiring lock "cinder-quobyte-20a6e5cf-1928-4f96-9887-b326d5acb542" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:48:27 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f01306fd-aa0a-4897-a52f-1a581b6d196d tempest-SnapshotDependencyTests-1442825553 None] Lock "cinder-quobyte-20a6e5cf-1928-4f96-9887-b326d5acb542" acquired by "delete_volume" :: waited 0.011s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:48:27 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47953d8-8f08-45d5-8ab4-dd7c6acb17e4]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:48:27 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f01306fd-aa0a-4897-a52f-1a581b6d196d tempest-SnapshotDependencyTests-1442825553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:27 devstack sudo[90681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542
Feb 28 04:48:27 devstack sudo[90681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:27 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3522feb-e55d-4dd5-ae6d-e609c2de3b0f tempest-VolumesListTestJSON-467788868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:48:27 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e3522feb-e55d-4dd5-ae6d-e609c2de3b0f tempest-VolumesListTestJSON-467788868 None] Flow 'volume_create_manager' (7dbee1c3-9f10-4923-9a4e-3efa99f7877d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:48:27 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e3522feb-e55d-4dd5-ae6d-e609c2de3b0f tempest-VolumesListTestJSON-467788868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19a6c8d3-be21-4608-bb8f-7e5a1c80e02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:48:27 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e3522feb-e55d-4dd5-ae6d-e609c2de3b0f tempest-VolumesListTestJSON-467788868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19a6c8d3-be21-4608-bb8f-7e5a1c80e02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-158469662',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c98068e4-450d-40a7-884c-a101d1ae98a2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6abb7da4bab4465089554ec23475de58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:48:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:48:28Z,use_quota=True,user_id='f521ad76529b4ea99ac5091be3dc631f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:48:27 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e3522feb-e55d-4dd5-ae6d-e609c2de3b0f tempest-VolumesListTestJSON-467788868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b087b64-2f58-4dc1-a9fe-00020c745093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:48:27 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e3522feb-e55d-4dd5-ae6d-e609c2de3b0f tempest-VolumesListTestJSON-467788868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b087b64-2f58-4dc1-a9fe-00020c745093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:48:27 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e3522feb-e55d-4dd5-ae6d-e609c2de3b0f tempest-VolumesListTestJSON-467788868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8372eec-3d15-412c-a7f6-4db5e0fc97e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:48:27 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e3522feb-e55d-4dd5-ae6d-e609c2de3b0f tempest-VolumesListTestJSON-467788868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8372eec-3d15-412c-a7f6-4db5e0fc97e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c98068e4-450d-40a7-884c-a101d1ae98a2', 'volume_name': 'volume-c98068e4-450d-40a7-884c-a101d1ae98a2', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:48:27 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e3522feb-e55d-4dd5-ae6d-e609c2de3b0f tempest-VolumesListTestJSON-467788868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faaf414d-9fe3-47e6-9e9a-7d45e408885a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:48:27 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e3522feb-e55d-4dd5-ae6d-e609c2de3b0f tempest-VolumesListTestJSON-467788868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faaf414d-9fe3-47e6-9e9a-7d45e408885a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:48:27 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e3522feb-e55d-4dd5-ae6d-e609c2de3b0f tempest-VolumesListTestJSON-467788868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44eb2f87-b7ad-40d5-abff-027688094ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:48:27 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-e3522feb-e55d-4dd5-ae6d-e609c2de3b0f tempest-VolumesListTestJSON-467788868 None] Volume c98068e4-450d-40a7-884c-a101d1ae98a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c98068e4-450d-40a7-884c-a101d1ae98a2', 'volume_size': 1}
Feb 28 04:48:27 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e3522feb-e55d-4dd5-ae6d-e609c2de3b0f tempest-VolumesListTestJSON-467788868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:48:27 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e3522feb-e55d-4dd5-ae6d-e609c2de3b0f tempest-VolumesListTestJSON-467788868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:48:27 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-e3522feb-e55d-4dd5-ae6d-e609c2de3b0f tempest-VolumesListTestJSON-467788868 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-158469662',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c98068e4-450d-40a7-884c-a101d1ae98a2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6abb7da4bab4465089554ec23475de58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:48:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:48:28Z,use_quota=True,user_id='f521ad76529b4ea99ac5091be3dc631f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:48:27 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-e3522feb-e55d-4dd5-ae6d-e609c2de3b0f tempest-VolumesListTestJSON-467788868 None] Creating volume c98068e4-450d-40a7-884c-a101d1ae98a2 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:48:27 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e3522feb-e55d-4dd5-ae6d-e609c2de3b0f tempest-VolumesListTestJSON-467788868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:48:27 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e3522feb-e55d-4dd5-ae6d-e609c2de3b0f tempest-VolumesListTestJSON-467788868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:48:27 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-e3522feb-e55d-4dd5-ae6d-e609c2de3b0f tempest-VolumesListTestJSON-467788868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:48:27 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-e3522feb-e55d-4dd5-ae6d-e609c2de3b0f tempest-VolumesListTestJSON-467788868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:48:27 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e3522feb-e55d-4dd5-ae6d-e609c2de3b0f tempest-VolumesListTestJSON-467788868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:48:27 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-e3522feb-e55d-4dd5-ae6d-e609c2de3b0f tempest-VolumesListTestJSON-467788868 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:48:27 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-e3522feb-e55d-4dd5-ae6d-e609c2de3b0f tempest-VolumesListTestJSON-467788868 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:48:27 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e3522feb-e55d-4dd5-ae6d-e609c2de3b0f tempest-VolumesListTestJSON-467788868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c98068e4-450d-40a7-884c-a101d1ae98a2 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:27 devstack sudo[90686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c98068e4-450d-40a7-884c-a101d1ae98a2 1073741824
Feb 28 04:48:27 devstack sudo[90686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:27 devstack sudo[90681]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:27 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f01306fd-aa0a-4897-a52f-1a581b6d196d tempest-SnapshotDependencyTests-1442825553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542" returned: 0 in 0.558s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:27 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f01306fd-aa0a-4897-a52f-1a581b6d196d tempest-SnapshotDependencyTests-1442825553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:27 devstack sudo[90688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542
Feb 28 04:48:27 devstack sudo[90688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:28 devstack sudo[90686]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e3522feb-e55d-4dd5-ae6d-e609c2de3b0f tempest-VolumesListTestJSON-467788868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c98068e4-450d-40a7-884c-a101d1ae98a2 1073741824" returned: 0 in 0.482s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e3522feb-e55d-4dd5-ae6d-e609c2de3b0f tempest-VolumesListTestJSON-467788868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c98068e4-450d-40a7-884c-a101d1ae98a2 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:28 devstack sudo[90688]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f01306fd-aa0a-4897-a52f-1a581b6d196d tempest-SnapshotDependencyTests-1442825553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-20a6e5cf-1928-4f96-9887-b326d5acb542" returned: 0 in 0.430s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:28 devstack sudo[90694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c98068e4-450d-40a7-884c-a101d1ae98a2
Feb 28 04:48:28 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f01306fd-aa0a-4897-a52f-1a581b6d196d tempest-SnapshotDependencyTests-1442825553 None] Lock "cinder-quobyte-20a6e5cf-1928-4f96-9887-b326d5acb542" released by "delete_volume" :: held 1.020s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:48:28 devstack sudo[90694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:28 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-f01306fd-aa0a-4897-a52f-1a581b6d196d tempest-SnapshotDependencyTests-1442825553 None] Created reservations ['c11647d3-ffe6-4b85-8a7b-1d7608deb5f0', '7ae5215e-e829-4950-b0ed-87c9a7f00cb3', '18a0359f-4987-4f97-94d3-0a3c4c3131f5', '993c6064-6e61-4463-b54b-3f802878db8d'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:48:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-f01306fd-aa0a-4897-a52f-1a581b6d196d tempest-SnapshotDependencyTests-1442825553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:48:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-f01306fd-aa0a-4897-a52f-1a581b6d196d tempest-SnapshotDependencyTests-1442825553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:48:28 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-f01306fd-aa0a-4897-a52f-1a581b6d196d tempest-SnapshotDependencyTests-1442825553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:48:28 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-f01306fd-aa0a-4897-a52f-1a581b6d196d tempest-SnapshotDependencyTests-1442825553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:48:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-f01306fd-aa0a-4897-a52f-1a581b6d196d tempest-SnapshotDependencyTests-1442825553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:48:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f01306fd-aa0a-4897-a52f-1a581b6d196d tempest-SnapshotDependencyTests-1442825553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:28 devstack sudo[90696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:48:28 devstack sudo[90696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:28 devstack sudo[90694]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e3522feb-e55d-4dd5-ae6d-e609c2de3b0f tempest-VolumesListTestJSON-467788868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c98068e4-450d-40a7-884c-a101d1ae98a2" returned: 0 in 0.410s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:28 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-e3522feb-e55d-4dd5-ae6d-e609c2de3b0f tempest-VolumesListTestJSON-467788868 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:48:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e3522feb-e55d-4dd5-ae6d-e609c2de3b0f tempest-VolumesListTestJSON-467788868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:48:28 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e3522feb-e55d-4dd5-ae6d-e609c2de3b0f tempest-VolumesListTestJSON-467788868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44eb2f87-b7ad-40d5-abff-027688094ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c98068e4-450d-40a7-884c-a101d1ae98a2', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:48:28 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e3522feb-e55d-4dd5-ae6d-e609c2de3b0f tempest-VolumesListTestJSON-467788868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5011244-576c-4dac-8649-2115598f60f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:48:28 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-e3522feb-e55d-4dd5-ae6d-e609c2de3b0f tempest-VolumesListTestJSON-467788868 None] Volume volume-c98068e4-450d-40a7-884c-a101d1ae98a2 (c98068e4-450d-40a7-884c-a101d1ae98a2): created successfully
Feb 28 04:48:28 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e3522feb-e55d-4dd5-ae6d-e609c2de3b0f tempest-VolumesListTestJSON-467788868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5011244-576c-4dac-8649-2115598f60f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:48:28 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e3522feb-e55d-4dd5-ae6d-e609c2de3b0f tempest-VolumesListTestJSON-467788868 None] Flow 'volume_create_manager' (7dbee1c3-9f10-4923-9a4e-3efa99f7877d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:48:28 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-e3522feb-e55d-4dd5-ae6d-e609c2de3b0f tempest-VolumesListTestJSON-467788868 None] Created volume successfully.
Feb 28 04:48:28 devstack sudo[90696]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f01306fd-aa0a-4897-a52f-1a581b6d196d tempest-SnapshotDependencyTests-1442825553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.425s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:28 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-f01306fd-aa0a-4897-a52f-1a581b6d196d tempest-SnapshotDependencyTests-1442825553 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:48:28 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-f01306fd-aa0a-4897-a52f-1a581b6d196d tempest-SnapshotDependencyTests-1442825553 None] Deleted volume successfully.
Feb 28 04:48:28 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f01306fd-aa0a-4897-a52f-1a581b6d196d tempest-SnapshotDependencyTests-1442825553 None] Lock "cinder-20a6e5cf-1928-4f96-9887-b326d5acb542-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:48:29 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-0ead59a1-0bea-4816-9825-fe3e22a416c7 tempest-SnapshotDependencyTests-1442825553 None] Acquiring lock "cinder-9e33f7a9-b5bb-496b-bc44-6b574bf224b5-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:48:29 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-0ead59a1-0bea-4816-9825-fe3e22a416c7 tempest-SnapshotDependencyTests-1442825553 None] Lock "cinder-9e33f7a9-b5bb-496b-bc44-6b574bf224b5-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:48:29 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-0ead59a1-0bea-4816-9825-fe3e22a416c7 tempest-SnapshotDependencyTests-1442825553 None] Acquiring lock "cinder-quobyte-9e33f7a9-b5bb-496b-bc44-6b574bf224b5" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:48:29 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-0ead59a1-0bea-4816-9825-fe3e22a416c7 tempest-SnapshotDependencyTests-1442825553 None] Lock "cinder-quobyte-9e33f7a9-b5bb-496b-bc44-6b574bf224b5" acquired by "delete_volume" :: waited 0.008s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:48:29 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[86600f55-182e-4b51-bcc6-197c2b318f1b]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:48:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-0ead59a1-0bea-4816-9825-fe3e22a416c7 tempest-SnapshotDependencyTests-1442825553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9e33f7a9-b5bb-496b-bc44-6b574bf224b5 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:29 devstack sudo[90700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9e33f7a9-b5bb-496b-bc44-6b574bf224b5
Feb 28 04:48:29 devstack sudo[90700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:29 devstack sudo[90700]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-0ead59a1-0bea-4816-9825-fe3e22a416c7 tempest-SnapshotDependencyTests-1442825553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9e33f7a9-b5bb-496b-bc44-6b574bf224b5" returned: 0 in 0.469s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-0ead59a1-0bea-4816-9825-fe3e22a416c7 tempest-SnapshotDependencyTests-1442825553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9e33f7a9-b5bb-496b-bc44-6b574bf224b5 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:29 devstack sudo[90706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9e33f7a9-b5bb-496b-bc44-6b574bf224b5
Feb 28 04:48:29 devstack sudo[90706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:30 devstack sudo[90706]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-0ead59a1-0bea-4816-9825-fe3e22a416c7 tempest-SnapshotDependencyTests-1442825553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9e33f7a9-b5bb-496b-bc44-6b574bf224b5" returned: 0 in 0.410s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:30 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-0ead59a1-0bea-4816-9825-fe3e22a416c7 tempest-SnapshotDependencyTests-1442825553 None] Lock "cinder-quobyte-9e33f7a9-b5bb-496b-bc44-6b574bf224b5" released by "delete_volume" :: held 0.901s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:48:30 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-0ead59a1-0bea-4816-9825-fe3e22a416c7 tempest-SnapshotDependencyTests-1442825553 None] Created reservations ['a189d0a6-fa1e-445b-8d38-7ad0830d4358', 'db948e93-0d03-4cff-9f93-b96a06037c9f', '25a583a1-8b02-4955-9ead-b00527cce9b8', '2fb614ad-fccc-45d0-a82c-5bdaa14a3787'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:48:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-0ead59a1-0bea-4816-9825-fe3e22a416c7 tempest-SnapshotDependencyTests-1442825553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:48:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-0ead59a1-0bea-4816-9825-fe3e22a416c7 tempest-SnapshotDependencyTests-1442825553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:48:30 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-0ead59a1-0bea-4816-9825-fe3e22a416c7 tempest-SnapshotDependencyTests-1442825553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:48:30 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-0ead59a1-0bea-4816-9825-fe3e22a416c7 tempest-SnapshotDependencyTests-1442825553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:48:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-0ead59a1-0bea-4816-9825-fe3e22a416c7 tempest-SnapshotDependencyTests-1442825553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:48:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-0ead59a1-0bea-4816-9825-fe3e22a416c7 tempest-SnapshotDependencyTests-1442825553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:30 devstack sudo[90709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:48:30 devstack sudo[90709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:30 devstack sudo[90709]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-0ead59a1-0bea-4816-9825-fe3e22a416c7 tempest-SnapshotDependencyTests-1442825553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.439s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:30 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-0ead59a1-0bea-4816-9825-fe3e22a416c7 tempest-SnapshotDependencyTests-1442825553 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:48:30 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-0ead59a1-0bea-4816-9825-fe3e22a416c7 tempest-SnapshotDependencyTests-1442825553 None] Deleted volume successfully.
Feb 28 04:48:30 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-0ead59a1-0bea-4816-9825-fe3e22a416c7 tempest-SnapshotDependencyTests-1442825553 None] Lock "cinder-9e33f7a9-b5bb-496b-bc44-6b574bf224b5-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:48:32 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f1350001-b049-4808-b23d-006d50f0455c tempest-VolumesListTestJSON-467788868 None] Acquiring lock "cinder-c98068e4-450d-40a7-884c-a101d1ae98a2-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:48:32 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f1350001-b049-4808-b23d-006d50f0455c tempest-VolumesListTestJSON-467788868 None] Lock "cinder-c98068e4-450d-40a7-884c-a101d1ae98a2-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:48:32 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f1350001-b049-4808-b23d-006d50f0455c tempest-VolumesListTestJSON-467788868 None] Acquiring lock "cinder-quobyte-c98068e4-450d-40a7-884c-a101d1ae98a2" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:48:32 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f1350001-b049-4808-b23d-006d50f0455c tempest-VolumesListTestJSON-467788868 None] Lock "cinder-quobyte-c98068e4-450d-40a7-884c-a101d1ae98a2" acquired by "delete_volume" :: waited 0.009s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:48:32 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f54629-1105-43af-9b1d-9d7df18f1bf3]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:48:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f1350001-b049-4808-b23d-006d50f0455c tempest-VolumesListTestJSON-467788868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c98068e4-450d-40a7-884c-a101d1ae98a2 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:32 devstack sudo[90713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c98068e4-450d-40a7-884c-a101d1ae98a2
Feb 28 04:48:32 devstack sudo[90713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:32 devstack sudo[90713]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f1350001-b049-4808-b23d-006d50f0455c tempest-VolumesListTestJSON-467788868 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c98068e4-450d-40a7-884c-a101d1ae98a2" returned: 0 in 0.492s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f1350001-b049-4808-b23d-006d50f0455c tempest-VolumesListTestJSON-467788868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c98068e4-450d-40a7-884c-a101d1ae98a2 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:32 devstack sudo[90718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c98068e4-450d-40a7-884c-a101d1ae98a2
Feb 28 04:48:32 devstack sudo[90718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:33 devstack sudo[90718]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f1350001-b049-4808-b23d-006d50f0455c tempest-VolumesListTestJSON-467788868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c98068e4-450d-40a7-884c-a101d1ae98a2" returned: 0 in 0.440s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:33 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f1350001-b049-4808-b23d-006d50f0455c tempest-VolumesListTestJSON-467788868 None] Lock "cinder-quobyte-c98068e4-450d-40a7-884c-a101d1ae98a2" released by "delete_volume" :: held 0.957s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:48:33 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-f1350001-b049-4808-b23d-006d50f0455c tempest-VolumesListTestJSON-467788868 None] Created reservations ['f012d552-4647-4d72-bfcf-45b1595581e8', 'e253d30d-dc07-4b6d-b175-6c09aa1e6816', '7e5167f5-2e5c-4db9-8ca6-48a50b63bb14', '946eefb4-4ae3-419f-9137-b01d210bddcd'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:48:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-f1350001-b049-4808-b23d-006d50f0455c tempest-VolumesListTestJSON-467788868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:48:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-f1350001-b049-4808-b23d-006d50f0455c tempest-VolumesListTestJSON-467788868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:48:33 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-f1350001-b049-4808-b23d-006d50f0455c tempest-VolumesListTestJSON-467788868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:48:33 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-f1350001-b049-4808-b23d-006d50f0455c tempest-VolumesListTestJSON-467788868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:48:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-f1350001-b049-4808-b23d-006d50f0455c tempest-VolumesListTestJSON-467788868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:48:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f1350001-b049-4808-b23d-006d50f0455c tempest-VolumesListTestJSON-467788868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:33 devstack sudo[90721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:48:33 devstack sudo[90721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:33 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-97b70f6a-eb62-4c12-9a69-37da13ea57bf tempest-VolumesListTestJSON-467788868 None] Acquiring lock "cinder-e1ecbe86-d39e-4997-97d7-7a7b968f467d-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:48:33 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-97b70f6a-eb62-4c12-9a69-37da13ea57bf tempest-VolumesListTestJSON-467788868 None] Lock "cinder-e1ecbe86-d39e-4997-97d7-7a7b968f467d-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:48:33 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-97b70f6a-eb62-4c12-9a69-37da13ea57bf tempest-VolumesListTestJSON-467788868 None] Acquiring lock "cinder-quobyte-e1ecbe86-d39e-4997-97d7-7a7b968f467d" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:48:33 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-97b70f6a-eb62-4c12-9a69-37da13ea57bf tempest-VolumesListTestJSON-467788868 None] Lock "cinder-quobyte-e1ecbe86-d39e-4997-97d7-7a7b968f467d" acquired by "delete_volume" :: waited 0.009s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:48:33 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[c116423d-865f-4f43-951d-c7decd3e4d76]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:48:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-97b70f6a-eb62-4c12-9a69-37da13ea57bf tempest-VolumesListTestJSON-467788868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e1ecbe86-d39e-4997-97d7-7a7b968f467d {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:33 devstack sudo[90724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e1ecbe86-d39e-4997-97d7-7a7b968f467d
Feb 28 04:48:33 devstack sudo[90724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:33 devstack sudo[90721]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f1350001-b049-4808-b23d-006d50f0455c tempest-VolumesListTestJSON-467788868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.462s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:33 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-f1350001-b049-4808-b23d-006d50f0455c tempest-VolumesListTestJSON-467788868 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:48:33 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-f1350001-b049-4808-b23d-006d50f0455c tempest-VolumesListTestJSON-467788868 None] Deleted volume successfully.
Feb 28 04:48:33 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f1350001-b049-4808-b23d-006d50f0455c tempest-VolumesListTestJSON-467788868 None] Lock "cinder-c98068e4-450d-40a7-884c-a101d1ae98a2-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:48:33 devstack sudo[90724]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-97b70f6a-eb62-4c12-9a69-37da13ea57bf tempest-VolumesListTestJSON-467788868 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e1ecbe86-d39e-4997-97d7-7a7b968f467d" returned: 0 in 0.545s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-97b70f6a-eb62-4c12-9a69-37da13ea57bf tempest-VolumesListTestJSON-467788868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e1ecbe86-d39e-4997-97d7-7a7b968f467d {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:33 devstack sudo[90730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e1ecbe86-d39e-4997-97d7-7a7b968f467d
Feb 28 04:48:33 devstack sudo[90730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:34 devstack sudo[90730]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-97b70f6a-eb62-4c12-9a69-37da13ea57bf tempest-VolumesListTestJSON-467788868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e1ecbe86-d39e-4997-97d7-7a7b968f467d" returned: 0 in 0.443s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:34 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-97b70f6a-eb62-4c12-9a69-37da13ea57bf tempest-VolumesListTestJSON-467788868 None] Lock "cinder-quobyte-e1ecbe86-d39e-4997-97d7-7a7b968f467d" released by "delete_volume" :: held 1.016s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:48:34 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-97b70f6a-eb62-4c12-9a69-37da13ea57bf tempest-VolumesListTestJSON-467788868 None] Created reservations ['0164564e-de5a-400d-84c2-9b780a5f0459', 'f4ff3df1-78da-4647-8121-a253dc9649a5', '291733c2-f967-4429-b63f-8b8833ec4bbd', 'a432739a-4e14-4e1f-a9d8-945d38f3f057'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:48:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-97b70f6a-eb62-4c12-9a69-37da13ea57bf tempest-VolumesListTestJSON-467788868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:48:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-97b70f6a-eb62-4c12-9a69-37da13ea57bf tempest-VolumesListTestJSON-467788868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:48:34 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-97b70f6a-eb62-4c12-9a69-37da13ea57bf tempest-VolumesListTestJSON-467788868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:48:34 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-97b70f6a-eb62-4c12-9a69-37da13ea57bf tempest-VolumesListTestJSON-467788868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:48:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-97b70f6a-eb62-4c12-9a69-37da13ea57bf tempest-VolumesListTestJSON-467788868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:48:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-97b70f6a-eb62-4c12-9a69-37da13ea57bf tempest-VolumesListTestJSON-467788868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:34 devstack sudo[90734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:48:34 devstack sudo[90734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:34 devstack sudo[90734]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-97b70f6a-eb62-4c12-9a69-37da13ea57bf tempest-VolumesListTestJSON-467788868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.451s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:34 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-97b70f6a-eb62-4c12-9a69-37da13ea57bf tempest-VolumesListTestJSON-467788868 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:48:34 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-97b70f6a-eb62-4c12-9a69-37da13ea57bf tempest-VolumesListTestJSON-467788868 None] Deleted volume successfully.
Feb 28 04:48:34 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-97b70f6a-eb62-4c12-9a69-37da13ea57bf tempest-VolumesListTestJSON-467788868 None] Lock "cinder-e1ecbe86-d39e-4997-97d7-7a7b968f467d-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:48:35 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-92119f1c-9455-4885-8de0-32bb07ed0f6a tempest-VolumesListTestJSON-467788868 None] Acquiring lock "cinder-1a5b9028-e4be-4b4a-a9c8-3c39285cb4fd-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:48:35 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-92119f1c-9455-4885-8de0-32bb07ed0f6a tempest-VolumesListTestJSON-467788868 None] Lock "cinder-1a5b9028-e4be-4b4a-a9c8-3c39285cb4fd-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:48:35 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-92119f1c-9455-4885-8de0-32bb07ed0f6a tempest-VolumesListTestJSON-467788868 None] Acquiring lock "cinder-quobyte-1a5b9028-e4be-4b4a-a9c8-3c39285cb4fd" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:48:35 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-92119f1c-9455-4885-8de0-32bb07ed0f6a tempest-VolumesListTestJSON-467788868 None] Lock "cinder-quobyte-1a5b9028-e4be-4b4a-a9c8-3c39285cb4fd" acquired by "delete_volume" :: waited 0.008s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:48:35 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9f4fb5-6987-4a4e-bfb6-b3100985d96c]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:48:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-92119f1c-9455-4885-8de0-32bb07ed0f6a tempest-VolumesListTestJSON-467788868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1a5b9028-e4be-4b4a-a9c8-3c39285cb4fd {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:35 devstack sudo[90737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1a5b9028-e4be-4b4a-a9c8-3c39285cb4fd
Feb 28 04:48:35 devstack sudo[90737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:36 devstack sudo[90737]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-92119f1c-9455-4885-8de0-32bb07ed0f6a tempest-VolumesListTestJSON-467788868 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1a5b9028-e4be-4b4a-a9c8-3c39285cb4fd" returned: 0 in 0.521s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-92119f1c-9455-4885-8de0-32bb07ed0f6a tempest-VolumesListTestJSON-467788868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1a5b9028-e4be-4b4a-a9c8-3c39285cb4fd {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:36 devstack sudo[90743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1a5b9028-e4be-4b4a-a9c8-3c39285cb4fd
Feb 28 04:48:36 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:36 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-92119f1c-9455-4885-8de0-32bb07ed0f6a tempest-VolumesListTestJSON-467788868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1a5b9028-e4be-4b4a-a9c8-3c39285cb4fd" returned: 0 in 0.447s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:36 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-92119f1c-9455-4885-8de0-32bb07ed0f6a tempest-VolumesListTestJSON-467788868 None] Lock "cinder-quobyte-1a5b9028-e4be-4b4a-a9c8-3c39285cb4fd" released by "delete_volume" :: held 1.017s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:48:36 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-92119f1c-9455-4885-8de0-32bb07ed0f6a tempest-VolumesListTestJSON-467788868 None] Created reservations ['5b0c0787-e19e-417d-8b2f-dc57fd9f3ba8', '0d8c2ec6-9106-4ab5-81ed-6ba32302bb52', 'b04e1314-967d-46b0-9e60-c92ffa570afe', '0e5d95f3-1434-42c4-bf0f-e3dbd6be3ceb'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:48:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-92119f1c-9455-4885-8de0-32bb07ed0f6a tempest-VolumesListTestJSON-467788868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:48:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-92119f1c-9455-4885-8de0-32bb07ed0f6a tempest-VolumesListTestJSON-467788868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:48:36 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-92119f1c-9455-4885-8de0-32bb07ed0f6a tempest-VolumesListTestJSON-467788868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:48:36 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-92119f1c-9455-4885-8de0-32bb07ed0f6a tempest-VolumesListTestJSON-467788868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:48:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-92119f1c-9455-4885-8de0-32bb07ed0f6a tempest-VolumesListTestJSON-467788868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:48:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-92119f1c-9455-4885-8de0-32bb07ed0f6a tempest-VolumesListTestJSON-467788868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:36 devstack sudo[90746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:48:36 devstack sudo[90746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:37 devstack sudo[90746]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-92119f1c-9455-4885-8de0-32bb07ed0f6a tempest-VolumesListTestJSON-467788868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.436s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:37 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-92119f1c-9455-4885-8de0-32bb07ed0f6a tempest-VolumesListTestJSON-467788868 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:48:37 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-92119f1c-9455-4885-8de0-32bb07ed0f6a tempest-VolumesListTestJSON-467788868 None] Deleted volume successfully.
Feb 28 04:48:37 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-92119f1c-9455-4885-8de0-32bb07ed0f6a tempest-VolumesListTestJSON-467788868 None] Lock "cinder-1a5b9028-e4be-4b4a-a9c8-3c39285cb4fd-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:48:39 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd4204b7-9356-44ea-9fbe-c82f5c18b66a tempest-VolumesNegativeTest-1557094111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:48:39 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-dd4204b7-9356-44ea-9fbe-c82f5c18b66a tempest-VolumesNegativeTest-1557094111 None] Flow 'volume_create_manager' (56c6155f-3b81-4a9c-99d0-e9f3077bf4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:48:39 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-dd4204b7-9356-44ea-9fbe-c82f5c18b66a tempest-VolumesNegativeTest-1557094111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3cc5dad-6d2d-4214-b27d-a02428440f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:48:39 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-dd4204b7-9356-44ea-9fbe-c82f5c18b66a tempest-VolumesNegativeTest-1557094111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3cc5dad-6d2d-4214-b27d-a02428440f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1551217571',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7213c8be-30c5-4df4-b133-c3ac90bb2bfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2de2cc144605476182176c9c9f539b8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:48:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:48:39Z,use_quota=True,user_id='d4730b8b319e425da5ed490ab3681ece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:48:39 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-dd4204b7-9356-44ea-9fbe-c82f5c18b66a tempest-VolumesNegativeTest-1557094111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c76a28fd-45a3-49b6-af97-8228bc51de30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:48:39 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-dd4204b7-9356-44ea-9fbe-c82f5c18b66a tempest-VolumesNegativeTest-1557094111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c76a28fd-45a3-49b6-af97-8228bc51de30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:48:39 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-dd4204b7-9356-44ea-9fbe-c82f5c18b66a tempest-VolumesNegativeTest-1557094111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b19bca58-9624-4e69-8ebe-13475b25bbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:48:39 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-dd4204b7-9356-44ea-9fbe-c82f5c18b66a tempest-VolumesNegativeTest-1557094111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b19bca58-9624-4e69-8ebe-13475b25bbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7213c8be-30c5-4df4-b133-c3ac90bb2bfe', 'volume_name': 'volume-7213c8be-30c5-4df4-b133-c3ac90bb2bfe', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:48:39 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-dd4204b7-9356-44ea-9fbe-c82f5c18b66a tempest-VolumesNegativeTest-1557094111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d15746f-ec6c-4d08-b686-a4d388976a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:48:39 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-dd4204b7-9356-44ea-9fbe-c82f5c18b66a tempest-VolumesNegativeTest-1557094111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d15746f-ec6c-4d08-b686-a4d388976a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:48:39 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-dd4204b7-9356-44ea-9fbe-c82f5c18b66a tempest-VolumesNegativeTest-1557094111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (079a2d09-990d-4809-b186-5e2579b58f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:48:39 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-dd4204b7-9356-44ea-9fbe-c82f5c18b66a tempest-VolumesNegativeTest-1557094111 None] Volume 7213c8be-30c5-4df4-b133-c3ac90bb2bfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7213c8be-30c5-4df4-b133-c3ac90bb2bfe', 'volume_size': 1}
Feb 28 04:48:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-dd4204b7-9356-44ea-9fbe-c82f5c18b66a tempest-VolumesNegativeTest-1557094111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:48:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-dd4204b7-9356-44ea-9fbe-c82f5c18b66a tempest-VolumesNegativeTest-1557094111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:48:39 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-dd4204b7-9356-44ea-9fbe-c82f5c18b66a tempest-VolumesNegativeTest-1557094111 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1551217571',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7213c8be-30c5-4df4-b133-c3ac90bb2bfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2de2cc144605476182176c9c9f539b8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:48:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:48:39Z,use_quota=True,user_id='d4730b8b319e425da5ed490ab3681ece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:48:39 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-dd4204b7-9356-44ea-9fbe-c82f5c18b66a tempest-VolumesNegativeTest-1557094111 None] Creating volume 7213c8be-30c5-4df4-b133-c3ac90bb2bfe {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:48:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-dd4204b7-9356-44ea-9fbe-c82f5c18b66a tempest-VolumesNegativeTest-1557094111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:48:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-dd4204b7-9356-44ea-9fbe-c82f5c18b66a tempest-VolumesNegativeTest-1557094111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:48:39 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-dd4204b7-9356-44ea-9fbe-c82f5c18b66a tempest-VolumesNegativeTest-1557094111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:48:39 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-dd4204b7-9356-44ea-9fbe-c82f5c18b66a tempest-VolumesNegativeTest-1557094111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:48:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-dd4204b7-9356-44ea-9fbe-c82f5c18b66a tempest-VolumesNegativeTest-1557094111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:48:39 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-dd4204b7-9356-44ea-9fbe-c82f5c18b66a tempest-VolumesNegativeTest-1557094111 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:48:39 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-dd4204b7-9356-44ea-9fbe-c82f5c18b66a tempest-VolumesNegativeTest-1557094111 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:48:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dd4204b7-9356-44ea-9fbe-c82f5c18b66a tempest-VolumesNegativeTest-1557094111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7213c8be-30c5-4df4-b133-c3ac90bb2bfe 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:39 devstack sudo[90749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7213c8be-30c5-4df4-b133-c3ac90bb2bfe 1073741824
Feb 28 04:48:39 devstack sudo[90749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:39 devstack sudo[90749]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dd4204b7-9356-44ea-9fbe-c82f5c18b66a tempest-VolumesNegativeTest-1557094111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7213c8be-30c5-4df4-b133-c3ac90bb2bfe 1073741824" returned: 0 in 0.473s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dd4204b7-9356-44ea-9fbe-c82f5c18b66a tempest-VolumesNegativeTest-1557094111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7213c8be-30c5-4df4-b133-c3ac90bb2bfe {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:48:39 devstack sudo[90755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7213c8be-30c5-4df4-b133-c3ac90bb2bfe
Feb 28 04:48:39 devstack sudo[90755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:48:40 devstack sudo[90755]: pam_unix(sudo:session): session closed for user root
Feb 28 04:48:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-dd4204b7-9356-44ea-9fbe-c82f5c18b66a tempest-VolumesNegativeTest-1557094111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7213c8be-30c5-4df4-b133-c3ac90bb2bfe" returned: 0 in 0.397s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:48:40 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-dd4204b7-9356-44ea-9fbe-c82f5c18b66a tempest-VolumesNegativeTest-1557094111 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:48:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-dd4204b7-9356-44ea-9fbe-c82f5c18b66a tempest-VolumesNegativeTest-1557094111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:48:40 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-dd4204b7-9356-44ea-9fbe-c82f5c18b66a tempest-VolumesNegativeTest-1557094111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (079a2d09-990d-4809-b186-5e2579b58f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7213c8be-30c5-4df4-b133-c3ac90bb2bfe', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:48:40 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-dd4204b7-9356-44ea-9fbe-c82f5c18b66a tempest-VolumesNegativeTest-1557094111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98258510-7723-4a90-a56f-c5a6b27c2a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:48:40 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-dd4204b7-9356-44ea-9fbe-c82f5c18b66a tempest-VolumesNegativeTest-1557094111 None] Volume volume-7213c8be-30c5-4df4-b133-c3ac90bb2bfe (7213c8be-30c5-4df4-b133-c3ac90bb2bfe): created successfully
Feb 28 04:48:40 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-dd4204b7-9356-44ea-9fbe-c82f5c18b66a tempest-VolumesNegativeTest-1557094111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98258510-7723-4a90-a56f-c5a6b27c2a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:48:40 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-dd4204b7-9356-44ea-9fbe-c82f5c18b66a tempest-VolumesNegativeTest-1557094111 None] Flow 'volume_create_manager' (56c6155f-3b81-4a9c-99d0-e9f3077bf4c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:48:40 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-dd4204b7-9356-44ea-9fbe-c82f5c18b66a tempest-VolumesNegativeTest-1557094111 None] Created volume successfully.
Feb 28 04:48:50 devstack cinder-volume[84248]: DEBUG dbcounter [-] [84248] Writing DB stats cinder:UPDATE=80,cinder:SELECT=56,cinder:DELETE=7,cinder:INSERT=16 {{(pid=84248) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 04:48:50 devstack cinder-volume[84248]: DEBUG dbcounter [-] [84248] Writing DB stats cinder:SELECT=50,cinder:INSERT=18,cinder:UPDATE=65,cinder:DELETE=6 {{(pid=84248) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 04:49:04 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-980604e9-9d76-4a9d-bf03-b87291ac6aa1 tempest-VolumesNegativeTest-1557094111 None] Acquiring lock "cinder-7213c8be-30c5-4df4-b133-c3ac90bb2bfe-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:49:04 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-980604e9-9d76-4a9d-bf03-b87291ac6aa1 tempest-VolumesNegativeTest-1557094111 None] Lock "cinder-7213c8be-30c5-4df4-b133-c3ac90bb2bfe-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:49:04 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-980604e9-9d76-4a9d-bf03-b87291ac6aa1 tempest-VolumesNegativeTest-1557094111 None] Acquiring lock "cinder-quobyte-7213c8be-30c5-4df4-b133-c3ac90bb2bfe" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:49:04 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-980604e9-9d76-4a9d-bf03-b87291ac6aa1 tempest-VolumesNegativeTest-1557094111 None] Lock "cinder-quobyte-7213c8be-30c5-4df4-b133-c3ac90bb2bfe" acquired by "delete_volume" :: waited 0.007s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:49:04 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[227d13e1-c411-42c4-9736-3af96db29f4a]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:49:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-980604e9-9d76-4a9d-bf03-b87291ac6aa1 tempest-VolumesNegativeTest-1557094111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7213c8be-30c5-4df4-b133-c3ac90bb2bfe {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:04 devstack sudo[90842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7213c8be-30c5-4df4-b133-c3ac90bb2bfe
Feb 28 04:49:04 devstack sudo[90842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:04 devstack sudo[90842]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-980604e9-9d76-4a9d-bf03-b87291ac6aa1 tempest-VolumesNegativeTest-1557094111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7213c8be-30c5-4df4-b133-c3ac90bb2bfe" returned: 0 in 0.447s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-980604e9-9d76-4a9d-bf03-b87291ac6aa1 tempest-VolumesNegativeTest-1557094111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7213c8be-30c5-4df4-b133-c3ac90bb2bfe {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:04 devstack sudo[90847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7213c8be-30c5-4df4-b133-c3ac90bb2bfe
Feb 28 04:49:04 devstack sudo[90847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:05 devstack sudo[90847]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-980604e9-9d76-4a9d-bf03-b87291ac6aa1 tempest-VolumesNegativeTest-1557094111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-7213c8be-30c5-4df4-b133-c3ac90bb2bfe" returned: 0 in 0.401s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:05 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-980604e9-9d76-4a9d-bf03-b87291ac6aa1 tempest-VolumesNegativeTest-1557094111 None] Lock "cinder-quobyte-7213c8be-30c5-4df4-b133-c3ac90bb2bfe" released by "delete_volume" :: held 0.874s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:49:05 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-980604e9-9d76-4a9d-bf03-b87291ac6aa1 tempest-VolumesNegativeTest-1557094111 None] Created reservations ['3202b9a6-a94c-4dce-9de9-a2aadd92f953', '85e07f20-7b5a-4541-a02b-abb9d2b5f6b4', '8f043d24-99af-461d-9d34-79db0f71b37c', '63209255-e55e-4465-b370-eec198826e5b'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:49:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-980604e9-9d76-4a9d-bf03-b87291ac6aa1 tempest-VolumesNegativeTest-1557094111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:49:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-980604e9-9d76-4a9d-bf03-b87291ac6aa1 tempest-VolumesNegativeTest-1557094111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:49:05 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-980604e9-9d76-4a9d-bf03-b87291ac6aa1 tempest-VolumesNegativeTest-1557094111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:49:05 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-980604e9-9d76-4a9d-bf03-b87291ac6aa1 tempest-VolumesNegativeTest-1557094111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:49:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-980604e9-9d76-4a9d-bf03-b87291ac6aa1 tempest-VolumesNegativeTest-1557094111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:49:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-980604e9-9d76-4a9d-bf03-b87291ac6aa1 tempest-VolumesNegativeTest-1557094111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:05 devstack sudo[90850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:49:05 devstack sudo[90850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:05 devstack sudo[90850]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-980604e9-9d76-4a9d-bf03-b87291ac6aa1 tempest-VolumesNegativeTest-1557094111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.435s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:05 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-980604e9-9d76-4a9d-bf03-b87291ac6aa1 tempest-VolumesNegativeTest-1557094111 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:49:05 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-980604e9-9d76-4a9d-bf03-b87291ac6aa1 tempest-VolumesNegativeTest-1557094111 None] Deleted volume successfully.
Feb 28 04:49:05 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-980604e9-9d76-4a9d-bf03-b87291ac6aa1 tempest-VolumesNegativeTest-1557094111 None] Lock "cinder-7213c8be-30c5-4df4-b133-c3ac90bb2bfe-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:49:06 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6ddf78c-cad6-4476-88f5-8c49d6759ee0 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:49:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e6ddf78c-cad6-4476-88f5-8c49d6759ee0 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Flow 'volume_create_manager' (1bcbca44-85bc-4c69-9c5c-be93b333be2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:49:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e6ddf78c-cad6-4476-88f5-8c49d6759ee0 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcb4462d-8c60-4f02-b42e-714bc69f6b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e6ddf78c-cad6-4476-88f5-8c49d6759ee0 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcb4462d-8c60-4f02-b42e-714bc69f6b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:49:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-725055552',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2983832994c463bb9db10c54fccabf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:49:07Z,use_quota=True,user_id='245ce12dddf44c9f88e59a857d94a904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e6ddf78c-cad6-4476-88f5-8c49d6759ee0 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a72f48b-051f-47f5-9a56-67e70cf3a1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e6ddf78c-cad6-4476-88f5-8c49d6759ee0 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a72f48b-051f-47f5-9a56-67e70cf3a1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e6ddf78c-cad6-4476-88f5-8c49d6759ee0 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eef37a66-b590-4493-9a58-70a0ffd511d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e6ddf78c-cad6-4476-88f5-8c49d6759ee0 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eef37a66-b590-4493-9a58-70a0ffd511d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4', 'volume_name': 'volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e6ddf78c-cad6-4476-88f5-8c49d6759ee0 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (490cfd10-3f06-419e-bad6-b49a4d072bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e6ddf78c-cad6-4476-88f5-8c49d6759ee0 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (490cfd10-3f06-419e-bad6-b49a4d072bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e6ddf78c-cad6-4476-88f5-8c49d6759ee0 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee5e7460-9798-46ca-9213-46a659e68cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:06 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-e6ddf78c-cad6-4476-88f5-8c49d6759ee0 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Volume ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4', 'volume_size': 1}
Feb 28 04:49:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e6ddf78c-cad6-4476-88f5-8c49d6759ee0 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:49:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e6ddf78c-cad6-4476-88f5-8c49d6759ee0 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:49:06 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-e6ddf78c-cad6-4476-88f5-8c49d6759ee0 tempest-CreateVolumesFromSnapshotTest-1058140897 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:49:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-725055552',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2983832994c463bb9db10c54fccabf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:49:07Z,use_quota=True,user_id='245ce12dddf44c9f88e59a857d94a904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:49:06 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-e6ddf78c-cad6-4476-88f5-8c49d6759ee0 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Creating volume ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:49:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e6ddf78c-cad6-4476-88f5-8c49d6759ee0 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:49:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e6ddf78c-cad6-4476-88f5-8c49d6759ee0 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:49:06 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-e6ddf78c-cad6-4476-88f5-8c49d6759ee0 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:49:06 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-e6ddf78c-cad6-4476-88f5-8c49d6759ee0 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:49:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e6ddf78c-cad6-4476-88f5-8c49d6759ee0 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:49:06 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-e6ddf78c-cad6-4476-88f5-8c49d6759ee0 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:49:06 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-e6ddf78c-cad6-4476-88f5-8c49d6759ee0 tempest-CreateVolumesFromSnapshotTest-1058140897 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:49:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e6ddf78c-cad6-4476-88f5-8c49d6759ee0 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:06 devstack sudo[90853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4 1073741824
Feb 28 04:49:06 devstack sudo[90853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:07 devstack sudo[90853]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e6ddf78c-cad6-4476-88f5-8c49d6759ee0 tempest-CreateVolumesFromSnapshotTest-1058140897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4 1073741824" returned: 0 in 0.471s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e6ddf78c-cad6-4476-88f5-8c49d6759ee0 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:07 devstack sudo[90858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4
Feb 28 04:49:07 devstack sudo[90858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:07 devstack sudo[90858]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e6ddf78c-cad6-4476-88f5-8c49d6759ee0 tempest-CreateVolumesFromSnapshotTest-1058140897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4" returned: 0 in 0.413s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:07 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-e6ddf78c-cad6-4476-88f5-8c49d6759ee0 tempest-CreateVolumesFromSnapshotTest-1058140897 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:49:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e6ddf78c-cad6-4476-88f5-8c49d6759ee0 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:49:07 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e6ddf78c-cad6-4476-88f5-8c49d6759ee0 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee5e7460-9798-46ca-9213-46a659e68cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:07 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e6ddf78c-cad6-4476-88f5-8c49d6759ee0 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a0f9208-eb86-477d-b659-d1b484648114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:07 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-e6ddf78c-cad6-4476-88f5-8c49d6759ee0 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Volume volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4 (ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4): created successfully
Feb 28 04:49:07 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e6ddf78c-cad6-4476-88f5-8c49d6759ee0 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a0f9208-eb86-477d-b659-d1b484648114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:07 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-e6ddf78c-cad6-4476-88f5-8c49d6759ee0 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Flow 'volume_create_manager' (1bcbca44-85bc-4c69-9c5c-be93b333be2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:49:07 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-e6ddf78c-cad6-4476-88f5-8c49d6759ee0 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Created volume successfully.
Feb 28 04:49:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-1952f7f8-c3ba-47a9-be5e-ca32e577220b tempest-CreateVolumesFromSnapshotTest-1058140897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:49:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-1952f7f8-c3ba-47a9-be5e-ca32e577220b tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:49:07 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-1952f7f8-c3ba-47a9-be5e-ca32e577220b tempest-CreateVolumesFromSnapshotTest-1058140897 None] Creating offline snapshot 76a17495-89e1-4d49-8d29-5faaa59e0cfb of volume ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4 {{(pid=84248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 04:49:07 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7fe4bae-b73c-415d-b8b7-0c45ffe5ad5f]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:49:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1952f7f8-c3ba-47a9-be5e-ca32e577220b tempest-CreateVolumesFromSnapshotTest-1058140897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:07 devstack sudo[90861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4
Feb 28 04:49:07 devstack sudo[90861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:08 devstack sudo[90861]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1952f7f8-c3ba-47a9-be5e-ca32e577220b tempest-CreateVolumesFromSnapshotTest-1058140897 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4" returned: 0 in 0.463s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1952f7f8-c3ba-47a9-be5e-ca32e577220b tempest-CreateVolumesFromSnapshotTest-1058140897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4.76a17495-89e1-4d49-8d29-5faaa59e0cfb 1G {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:08 devstack sudo[90866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4.76a17495-89e1-4d49-8d29-5faaa59e0cfb 1G
Feb 28 04:49:08 devstack sudo[90866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:08 devstack sudo[90866]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1952f7f8-c3ba-47a9-be5e-ca32e577220b tempest-CreateVolumesFromSnapshotTest-1058140897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4.76a17495-89e1-4d49-8d29-5faaa59e0cfb 1G" returned: 0 in 0.453s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1952f7f8-c3ba-47a9-be5e-ca32e577220b tempest-CreateVolumesFromSnapshotTest-1058140897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4.76a17495-89e1-4d49-8d29-5faaa59e0cfb {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:08 devstack sudo[90871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4.76a17495-89e1-4d49-8d29-5faaa59e0cfb
Feb 28 04:49:08 devstack sudo[90871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:09 devstack sudo[90871]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:09 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1952f7f8-c3ba-47a9-be5e-ca32e577220b tempest-CreateVolumesFromSnapshotTest-1058140897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4.76a17495-89e1-4d49-8d29-5faaa59e0cfb" returned: 0 in 0.417s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:09 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-1952f7f8-c3ba-47a9-be5e-ca32e577220b tempest-CreateVolumesFromSnapshotTest-1058140897 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4.76a17495-89e1-4d49-8d29-5faaa59e0cfb is being set with open permissions: ugo+rw
Feb 28 04:49:09 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1952f7f8-c3ba-47a9-be5e-ca32e577220b tempest-CreateVolumesFromSnapshotTest-1058140897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4.76a17495-89e1-4d49-8d29-5faaa59e0cfb {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:09 devstack sudo[90876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4.76a17495-89e1-4d49-8d29-5faaa59e0cfb
Feb 28 04:49:09 devstack sudo[90876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:09 devstack sudo[90876]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:09 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1952f7f8-c3ba-47a9-be5e-ca32e577220b tempest-CreateVolumesFromSnapshotTest-1058140897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4.76a17495-89e1-4d49-8d29-5faaa59e0cfb" returned: 0 in 0.394s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:09 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1952f7f8-c3ba-47a9-be5e-ca32e577220b tempest-CreateVolumesFromSnapshotTest-1058140897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:09 devstack sudo[90879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4.info
Feb 28 04:49:09 devstack sudo[90879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:10 devstack sudo[90879]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1952f7f8-c3ba-47a9-be5e-ca32e577220b tempest-CreateVolumesFromSnapshotTest-1058140897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4.info" returned: 0 in 0.409s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:10 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-1952f7f8-c3ba-47a9-be5e-ca32e577220b tempest-CreateVolumesFromSnapshotTest-1058140897 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4.info is being set with open permissions: ugo+rw
Feb 28 04:49:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1952f7f8-c3ba-47a9-be5e-ca32e577220b tempest-CreateVolumesFromSnapshotTest-1058140897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:10 devstack sudo[90883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4.info
Feb 28 04:49:10 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:10 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1952f7f8-c3ba-47a9-be5e-ca32e577220b tempest-CreateVolumesFromSnapshotTest-1058140897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4.info" returned: 0 in 0.412s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-1952f7f8-c3ba-47a9-be5e-ca32e577220b tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.606s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:49:10 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-1952f7f8-c3ba-47a9-be5e-ca32e577220b tempest-CreateVolumesFromSnapshotTest-1058140897 None] Create snapshot completed successfully
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c2d181b-1803-475a-8f6b-22a4561a3cbc tempest-CreateVolumesFromSnapshotTest-1058140897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5c2d181b-1803-475a-8f6b-22a4561a3cbc tempest-CreateVolumesFromSnapshotTest-1058140897 None] Flow 'volume_create_manager' (accbcddd-862d-4d95-a93b-d70deaaf7365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5c2d181b-1803-475a-8f6b-22a4561a3cbc tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (365caae9-0e50-46b9-9e4a-72f61a0256a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5c2d181b-1803-475a-8f6b-22a4561a3cbc tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (365caae9-0e50-46b9-9e4a-72f61a0256a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1375183184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94585c52-bcac-4d62-af13-52032ed3eb49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2983832994c463bb9db10c54fccabf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:49:11Z,use_quota=True,user_id='245ce12dddf44c9f88e59a857d94a904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5c2d181b-1803-475a-8f6b-22a4561a3cbc tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d8cdb4e-57bb-4b83-91db-1a25c50f1c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5c2d181b-1803-475a-8f6b-22a4561a3cbc tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d8cdb4e-57bb-4b83-91db-1a25c50f1c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5c2d181b-1803-475a-8f6b-22a4561a3cbc tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4a4159e-09a9-46ad-b5a2-9f9d5fdd94b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5c2d181b-1803-475a-8f6b-22a4561a3cbc tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4a4159e-09a9-46ad-b5a2-9f9d5fdd94b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94585c52-bcac-4d62-af13-52032ed3eb49', 'volume_name': 'volume-94585c52-bcac-4d62-af13-52032ed3eb49', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5c2d181b-1803-475a-8f6b-22a4561a3cbc tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8585a4b6-30e8-4bea-ac93-2aec34fbc14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5c2d181b-1803-475a-8f6b-22a4561a3cbc tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8585a4b6-30e8-4bea-ac93-2aec34fbc14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5c2d181b-1803-475a-8f6b-22a4561a3cbc tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9f7ed2b-604a-4b7d-9a59-fa4fbb333c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:11 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-5c2d181b-1803-475a-8f6b-22a4561a3cbc tempest-CreateVolumesFromSnapshotTest-1058140897 None] Volume 94585c52-bcac-4d62-af13-52032ed3eb49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94585c52-bcac-4d62-af13-52032ed3eb49', 'volume_size': 1}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5c2d181b-1803-475a-8f6b-22a4561a3cbc tempest-CreateVolumesFromSnapshotTest-1058140897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5c2d181b-1803-475a-8f6b-22a4561a3cbc tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-5c2d181b-1803-475a-8f6b-22a4561a3cbc tempest-CreateVolumesFromSnapshotTest-1058140897 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1375183184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94585c52-bcac-4d62-af13-52032ed3eb49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2983832994c463bb9db10c54fccabf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:49:11Z,use_quota=True,user_id='245ce12dddf44c9f88e59a857d94a904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-5c2d181b-1803-475a-8f6b-22a4561a3cbc tempest-CreateVolumesFromSnapshotTest-1058140897 None] Creating volume 94585c52-bcac-4d62-af13-52032ed3eb49 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5c2d181b-1803-475a-8f6b-22a4561a3cbc tempest-CreateVolumesFromSnapshotTest-1058140897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5c2d181b-1803-475a-8f6b-22a4561a3cbc tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-5c2d181b-1803-475a-8f6b-22a4561a3cbc tempest-CreateVolumesFromSnapshotTest-1058140897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-5c2d181b-1803-475a-8f6b-22a4561a3cbc tempest-CreateVolumesFromSnapshotTest-1058140897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5c2d181b-1803-475a-8f6b-22a4561a3cbc tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-5c2d181b-1803-475a-8f6b-22a4561a3cbc tempest-CreateVolumesFromSnapshotTest-1058140897 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:49:11 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-5c2d181b-1803-475a-8f6b-22a4561a3cbc tempest-CreateVolumesFromSnapshotTest-1058140897 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5c2d181b-1803-475a-8f6b-22a4561a3cbc tempest-CreateVolumesFromSnapshotTest-1058140897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-94585c52-bcac-4d62-af13-52032ed3eb49 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:11 devstack sudo[90886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-94585c52-bcac-4d62-af13-52032ed3eb49 1073741824
Feb 28 04:49:11 devstack sudo[90886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-59fc1397-39fe-43dd-a3ec-9ff067f0f7c1 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-59fc1397-39fe-43dd-a3ec-9ff067f0f7c1 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Flow 'volume_create_manager' (6be3796f-d6ba-409c-bb45-2c33018cdfab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-59fc1397-39fe-43dd-a3ec-9ff067f0f7c1 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb65ceb1-54b7-4ee5-b0d1-7a518e3972be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-59fc1397-39fe-43dd-a3ec-9ff067f0f7c1 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb65ceb1-54b7-4ee5-b0d1-7a518e3972be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1103173417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4460180b-ddfd-4ff7-ba2e-94e6df0f8d89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2983832994c463bb9db10c54fccabf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:49:11Z,use_quota=True,user_id='245ce12dddf44c9f88e59a857d94a904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-59fc1397-39fe-43dd-a3ec-9ff067f0f7c1 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6270e08-4fdc-4780-b024-b48b2a744c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-59fc1397-39fe-43dd-a3ec-9ff067f0f7c1 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6270e08-4fdc-4780-b024-b48b2a744c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-59fc1397-39fe-43dd-a3ec-9ff067f0f7c1 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d23a9d88-805e-449c-aea5-2de3071fc1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-59fc1397-39fe-43dd-a3ec-9ff067f0f7c1 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d23a9d88-805e-449c-aea5-2de3071fc1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4460180b-ddfd-4ff7-ba2e-94e6df0f8d89', 'volume_name': 'volume-4460180b-ddfd-4ff7-ba2e-94e6df0f8d89', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-59fc1397-39fe-43dd-a3ec-9ff067f0f7c1 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62223a84-2fca-4719-9822-87f6dda39dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-59fc1397-39fe-43dd-a3ec-9ff067f0f7c1 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62223a84-2fca-4719-9822-87f6dda39dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-59fc1397-39fe-43dd-a3ec-9ff067f0f7c1 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90397c66-c2a6-4182-a70a-e47ef5124472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:11 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-59fc1397-39fe-43dd-a3ec-9ff067f0f7c1 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Volume 4460180b-ddfd-4ff7-ba2e-94e6df0f8d89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4460180b-ddfd-4ff7-ba2e-94e6df0f8d89', 'volume_size': 1}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-59fc1397-39fe-43dd-a3ec-9ff067f0f7c1 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-20207fba-16cc-48b2-9249-76a83fb1ecfb tempest-CreateVolumesFromSnapshotTest-1058140897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-20207fba-16cc-48b2-9249-76a83fb1ecfb tempest-CreateVolumesFromSnapshotTest-1058140897 None] Flow 'volume_create_manager' (f7642443-4e0a-49d9-acec-269b4b6eaef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-20207fba-16cc-48b2-9249-76a83fb1ecfb tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4c3d4db-8597-4201-a199-8ca299d7b331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-20207fba-16cc-48b2-9249-76a83fb1ecfb tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4c3d4db-8597-4201-a199-8ca299d7b331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1600284204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b49ebdb9-fcd0-49de-ae28-ded14bb6b21b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2983832994c463bb9db10c54fccabf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:49:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:49:12Z,use_quota=True,user_id='245ce12dddf44c9f88e59a857d94a904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-20207fba-16cc-48b2-9249-76a83fb1ecfb tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cd9fcbc-ce8c-406f-b4c9-51a3f83445d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-20207fba-16cc-48b2-9249-76a83fb1ecfb tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cd9fcbc-ce8c-406f-b4c9-51a3f83445d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-20207fba-16cc-48b2-9249-76a83fb1ecfb tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81d8470a-f4fc-4764-9927-154d7c0b714e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-20207fba-16cc-48b2-9249-76a83fb1ecfb tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81d8470a-f4fc-4764-9927-154d7c0b714e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b49ebdb9-fcd0-49de-ae28-ded14bb6b21b', 'volume_name': 'volume-b49ebdb9-fcd0-49de-ae28-ded14bb6b21b', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-20207fba-16cc-48b2-9249-76a83fb1ecfb tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c880dafe-8f99-4f12-9f49-c309eb02a0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-20207fba-16cc-48b2-9249-76a83fb1ecfb tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c880dafe-8f99-4f12-9f49-c309eb02a0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-20207fba-16cc-48b2-9249-76a83fb1ecfb tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b65a90ba-b6d9-4f3b-b671-ab3d8cc075d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:11 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-20207fba-16cc-48b2-9249-76a83fb1ecfb tempest-CreateVolumesFromSnapshotTest-1058140897 None] Volume b49ebdb9-fcd0-49de-ae28-ded14bb6b21b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b49ebdb9-fcd0-49de-ae28-ded14bb6b21b', 'volume_size': 1}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-20207fba-16cc-48b2-9249-76a83fb1ecfb tempest-CreateVolumesFromSnapshotTest-1058140897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-781970cd-52ba-4f83-8f37-7f62d77dd0c8 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:49:11 devstack sudo[90886]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-781970cd-52ba-4f83-8f37-7f62d77dd0c8 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Flow 'volume_create_manager' (69f1fb41-88c8-4a21-b85f-38db46ae866d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-781970cd-52ba-4f83-8f37-7f62d77dd0c8 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6265d604-2249-4d1b-9fe8-d903318bf2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5c2d181b-1803-475a-8f6b-22a4561a3cbc tempest-CreateVolumesFromSnapshotTest-1058140897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-94585c52-bcac-4d62-af13-52032ed3eb49 1073741824" returned: 0 in 0.612s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-781970cd-52ba-4f83-8f37-7f62d77dd0c8 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6265d604-2249-4d1b-9fe8-d903318bf2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1896802155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b94e70cc-45e4-4243-b0e7-f42852b6200f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2983832994c463bb9db10c54fccabf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:49:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:49:12Z,use_quota=True,user_id='245ce12dddf44c9f88e59a857d94a904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-781970cd-52ba-4f83-8f37-7f62d77dd0c8 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e34bdcb-3174-4841-9814-d63136e910a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-781970cd-52ba-4f83-8f37-7f62d77dd0c8 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e34bdcb-3174-4841-9814-d63136e910a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-781970cd-52ba-4f83-8f37-7f62d77dd0c8 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca07b8b5-3358-43a5-bf76-c48adef6fced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-781970cd-52ba-4f83-8f37-7f62d77dd0c8 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca07b8b5-3358-43a5-bf76-c48adef6fced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b94e70cc-45e4-4243-b0e7-f42852b6200f', 'volume_name': 'volume-b94e70cc-45e4-4243-b0e7-f42852b6200f', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-781970cd-52ba-4f83-8f37-7f62d77dd0c8 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c62f9b3-fcf8-4984-a849-00e6ceba097b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-781970cd-52ba-4f83-8f37-7f62d77dd0c8 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c62f9b3-fcf8-4984-a849-00e6ceba097b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-781970cd-52ba-4f83-8f37-7f62d77dd0c8 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ef8f5ed-c5ad-4f6b-bc18-a668cb8ce55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:11 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-781970cd-52ba-4f83-8f37-7f62d77dd0c8 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Volume b94e70cc-45e4-4243-b0e7-f42852b6200f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b94e70cc-45e4-4243-b0e7-f42852b6200f', 'volume_size': 1}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-781970cd-52ba-4f83-8f37-7f62d77dd0c8 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5c2d181b-1803-475a-8f6b-22a4561a3cbc tempest-CreateVolumesFromSnapshotTest-1058140897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-94585c52-bcac-4d62-af13-52032ed3eb49 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:11 devstack sudo[90891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-94585c52-bcac-4d62-af13-52032ed3eb49
Feb 28 04:49:11 devstack sudo[90891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:11 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-01089e23-db92-4ec7-ae5a-a577959a4aad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:49:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-01089e23-db92-4ec7-ae5a-a577959a4aad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Flow 'volume_create_manager' (ad1fcf78-5df7-4542-baaf-7314feddf061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:49:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-01089e23-db92-4ec7-ae5a-a577959a4aad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5d934ea-9698-4354-86e2-5ff581b95f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-01089e23-db92-4ec7-ae5a-a577959a4aad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5d934ea-9698-4354-86e2-5ff581b95f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1575822787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=052cd19f-d459-4510-9ca6-51f437accd33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2983832994c463bb9db10c54fccabf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:49:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:49:12Z,use_quota=True,user_id='245ce12dddf44c9f88e59a857d94a904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-01089e23-db92-4ec7-ae5a-a577959a4aad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51321f3a-34ef-429e-b3c3-47283ce8d0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-01089e23-db92-4ec7-ae5a-a577959a4aad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51321f3a-34ef-429e-b3c3-47283ce8d0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-01089e23-db92-4ec7-ae5a-a577959a4aad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e342cc2-24d9-413f-a06f-fcb7c293aed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-01089e23-db92-4ec7-ae5a-a577959a4aad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e342cc2-24d9-413f-a06f-fcb7c293aed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '052cd19f-d459-4510-9ca6-51f437accd33', 'volume_name': 'volume-052cd19f-d459-4510-9ca6-51f437accd33', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-01089e23-db92-4ec7-ae5a-a577959a4aad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (436ef215-3685-4c38-84f3-2903af98b176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-01089e23-db92-4ec7-ae5a-a577959a4aad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (436ef215-3685-4c38-84f3-2903af98b176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-01089e23-db92-4ec7-ae5a-a577959a4aad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (659fb25a-a0a2-40ff-a8a3-5102d67ff364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:12 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-01089e23-db92-4ec7-ae5a-a577959a4aad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Volume 052cd19f-d459-4510-9ca6-51f437accd33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-052cd19f-d459-4510-9ca6-51f437accd33', 'volume_size': 1}
Feb 28 04:49:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-01089e23-db92-4ec7-ae5a-a577959a4aad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:49:12 devstack sudo[90891]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5c2d181b-1803-475a-8f6b-22a4561a3cbc tempest-CreateVolumesFromSnapshotTest-1058140897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-94585c52-bcac-4d62-af13-52032ed3eb49" returned: 0 in 0.423s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:12 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-5c2d181b-1803-475a-8f6b-22a4561a3cbc tempest-CreateVolumesFromSnapshotTest-1058140897 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:49:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5c2d181b-1803-475a-8f6b-22a4561a3cbc tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:49:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-59fc1397-39fe-43dd-a3ec-9ff067f0f7c1 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.887s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:49:12 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-59fc1397-39fe-43dd-a3ec-9ff067f0f7c1 tempest-CreateVolumesFromSnapshotTest-1058140897 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1103173417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4460180b-ddfd-4ff7-ba2e-94e6df0f8d89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2983832994c463bb9db10c54fccabf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:49:11Z,use_quota=True,user_id='245ce12dddf44c9f88e59a857d94a904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:49:12 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-59fc1397-39fe-43dd-a3ec-9ff067f0f7c1 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Creating volume 4460180b-ddfd-4ff7-ba2e-94e6df0f8d89 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:49:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-59fc1397-39fe-43dd-a3ec-9ff067f0f7c1 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:49:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-59fc1397-39fe-43dd-a3ec-9ff067f0f7c1 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:49:12 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-59fc1397-39fe-43dd-a3ec-9ff067f0f7c1 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:49:12 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-59fc1397-39fe-43dd-a3ec-9ff067f0f7c1 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:49:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-59fc1397-39fe-43dd-a3ec-9ff067f0f7c1 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:49:12 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-59fc1397-39fe-43dd-a3ec-9ff067f0f7c1 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:49:12 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-59fc1397-39fe-43dd-a3ec-9ff067f0f7c1 tempest-CreateVolumesFromSnapshotTest-1058140897 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:49:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-59fc1397-39fe-43dd-a3ec-9ff067f0f7c1 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4460180b-ddfd-4ff7-ba2e-94e6df0f8d89 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5c2d181b-1803-475a-8f6b-22a4561a3cbc tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9f7ed2b-604a-4b7d-9a59-fa4fbb333c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94585c52-bcac-4d62-af13-52032ed3eb49', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:12 devstack sudo[90894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4460180b-ddfd-4ff7-ba2e-94e6df0f8d89 1073741824
Feb 28 04:49:12 devstack sudo[90894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5c2d181b-1803-475a-8f6b-22a4561a3cbc tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (127dc3e3-cf0c-4c38-90ac-7c9853bcbc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:12 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-5c2d181b-1803-475a-8f6b-22a4561a3cbc tempest-CreateVolumesFromSnapshotTest-1058140897 None] Volume volume-94585c52-bcac-4d62-af13-52032ed3eb49 (94585c52-bcac-4d62-af13-52032ed3eb49): created successfully
Feb 28 04:49:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5c2d181b-1803-475a-8f6b-22a4561a3cbc tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (127dc3e3-cf0c-4c38-90ac-7c9853bcbc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5c2d181b-1803-475a-8f6b-22a4561a3cbc tempest-CreateVolumesFromSnapshotTest-1058140897 None] Flow 'volume_create_manager' (accbcddd-862d-4d95-a93b-d70deaaf7365) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:49:12 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-5c2d181b-1803-475a-8f6b-22a4561a3cbc tempest-CreateVolumesFromSnapshotTest-1058140897 None] Created volume successfully.
Feb 28 04:49:12 devstack sudo[90894]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-59fc1397-39fe-43dd-a3ec-9ff067f0f7c1 tempest-CreateVolumesFromSnapshotTest-1058140897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4460180b-ddfd-4ff7-ba2e-94e6df0f8d89 1073741824" returned: 0 in 0.464s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-59fc1397-39fe-43dd-a3ec-9ff067f0f7c1 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4460180b-ddfd-4ff7-ba2e-94e6df0f8d89 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:12 devstack sudo[90899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4460180b-ddfd-4ff7-ba2e-94e6df0f8d89
Feb 28 04:49:12 devstack sudo[90899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:13 devstack sudo[90899]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-59fc1397-39fe-43dd-a3ec-9ff067f0f7c1 tempest-CreateVolumesFromSnapshotTest-1058140897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4460180b-ddfd-4ff7-ba2e-94e6df0f8d89" returned: 0 in 0.414s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:13 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-59fc1397-39fe-43dd-a3ec-9ff067f0f7c1 tempest-CreateVolumesFromSnapshotTest-1058140897 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:49:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-59fc1397-39fe-43dd-a3ec-9ff067f0f7c1 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:49:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-20207fba-16cc-48b2-9249-76a83fb1ecfb tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.598s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:49:13 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-20207fba-16cc-48b2-9249-76a83fb1ecfb tempest-CreateVolumesFromSnapshotTest-1058140897 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1600284204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b49ebdb9-fcd0-49de-ae28-ded14bb6b21b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2983832994c463bb9db10c54fccabf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:49:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:49:12Z,use_quota=True,user_id='245ce12dddf44c9f88e59a857d94a904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:49:13 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-20207fba-16cc-48b2-9249-76a83fb1ecfb tempest-CreateVolumesFromSnapshotTest-1058140897 None] Creating volume b49ebdb9-fcd0-49de-ae28-ded14bb6b21b {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:49:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-20207fba-16cc-48b2-9249-76a83fb1ecfb tempest-CreateVolumesFromSnapshotTest-1058140897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:49:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-20207fba-16cc-48b2-9249-76a83fb1ecfb tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:49:13 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-20207fba-16cc-48b2-9249-76a83fb1ecfb tempest-CreateVolumesFromSnapshotTest-1058140897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:49:13 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-20207fba-16cc-48b2-9249-76a83fb1ecfb tempest-CreateVolumesFromSnapshotTest-1058140897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:49:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-20207fba-16cc-48b2-9249-76a83fb1ecfb tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:49:13 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-20207fba-16cc-48b2-9249-76a83fb1ecfb tempest-CreateVolumesFromSnapshotTest-1058140897 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:49:13 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-20207fba-16cc-48b2-9249-76a83fb1ecfb tempest-CreateVolumesFromSnapshotTest-1058140897 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:49:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-20207fba-16cc-48b2-9249-76a83fb1ecfb tempest-CreateVolumesFromSnapshotTest-1058140897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b49ebdb9-fcd0-49de-ae28-ded14bb6b21b 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:13 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-59fc1397-39fe-43dd-a3ec-9ff067f0f7c1 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90397c66-c2a6-4182-a70a-e47ef5124472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4460180b-ddfd-4ff7-ba2e-94e6df0f8d89', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:13 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-59fc1397-39fe-43dd-a3ec-9ff067f0f7c1 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeaeaa33-204f-4d17-ae4c-34eb6fb568fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:13 devstack sudo[90902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b49ebdb9-fcd0-49de-ae28-ded14bb6b21b 1073741824
Feb 28 04:49:13 devstack sudo[90902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:13 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-59fc1397-39fe-43dd-a3ec-9ff067f0f7c1 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Volume volume-4460180b-ddfd-4ff7-ba2e-94e6df0f8d89 (4460180b-ddfd-4ff7-ba2e-94e6df0f8d89): created successfully
Feb 28 04:49:13 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-59fc1397-39fe-43dd-a3ec-9ff067f0f7c1 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeaeaa33-204f-4d17-ae4c-34eb6fb568fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:13 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-59fc1397-39fe-43dd-a3ec-9ff067f0f7c1 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Flow 'volume_create_manager' (6be3796f-d6ba-409c-bb45-2c33018cdfab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:49:13 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-59fc1397-39fe-43dd-a3ec-9ff067f0f7c1 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Created volume successfully.
Feb 28 04:49:13 devstack sudo[90902]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-20207fba-16cc-48b2-9249-76a83fb1ecfb tempest-CreateVolumesFromSnapshotTest-1058140897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b49ebdb9-fcd0-49de-ae28-ded14bb6b21b 1073741824" returned: 0 in 0.470s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-20207fba-16cc-48b2-9249-76a83fb1ecfb tempest-CreateVolumesFromSnapshotTest-1058140897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b49ebdb9-fcd0-49de-ae28-ded14bb6b21b {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:13 devstack sudo[90907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b49ebdb9-fcd0-49de-ae28-ded14bb6b21b
Feb 28 04:49:13 devstack sudo[90907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:14 devstack sudo[90907]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-20207fba-16cc-48b2-9249-76a83fb1ecfb tempest-CreateVolumesFromSnapshotTest-1058140897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b49ebdb9-fcd0-49de-ae28-ded14bb6b21b" returned: 0 in 0.401s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:14 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-20207fba-16cc-48b2-9249-76a83fb1ecfb tempest-CreateVolumesFromSnapshotTest-1058140897 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:49:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-20207fba-16cc-48b2-9249-76a83fb1ecfb tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:49:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-781970cd-52ba-4f83-8f37-7f62d77dd0c8 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.252s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:49:14 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-781970cd-52ba-4f83-8f37-7f62d77dd0c8 tempest-CreateVolumesFromSnapshotTest-1058140897 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1896802155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b94e70cc-45e4-4243-b0e7-f42852b6200f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2983832994c463bb9db10c54fccabf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:49:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:49:12Z,use_quota=True,user_id='245ce12dddf44c9f88e59a857d94a904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:49:14 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-781970cd-52ba-4f83-8f37-7f62d77dd0c8 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Creating volume b94e70cc-45e4-4243-b0e7-f42852b6200f {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:49:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-781970cd-52ba-4f83-8f37-7f62d77dd0c8 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:49:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-781970cd-52ba-4f83-8f37-7f62d77dd0c8 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:49:14 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-781970cd-52ba-4f83-8f37-7f62d77dd0c8 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:49:14 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-781970cd-52ba-4f83-8f37-7f62d77dd0c8 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:49:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-781970cd-52ba-4f83-8f37-7f62d77dd0c8 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:49:14 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-781970cd-52ba-4f83-8f37-7f62d77dd0c8 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:49:14 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-781970cd-52ba-4f83-8f37-7f62d77dd0c8 tempest-CreateVolumesFromSnapshotTest-1058140897 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:49:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-781970cd-52ba-4f83-8f37-7f62d77dd0c8 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b94e70cc-45e4-4243-b0e7-f42852b6200f 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:14 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-20207fba-16cc-48b2-9249-76a83fb1ecfb tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b65a90ba-b6d9-4f3b-b671-ab3d8cc075d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b49ebdb9-fcd0-49de-ae28-ded14bb6b21b', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:14 devstack sudo[90910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b94e70cc-45e4-4243-b0e7-f42852b6200f 1073741824
Feb 28 04:49:14 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-20207fba-16cc-48b2-9249-76a83fb1ecfb tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dd5abf5-b366-43f8-a7eb-0adc5e9e716e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:14 devstack sudo[90910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:14 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-20207fba-16cc-48b2-9249-76a83fb1ecfb tempest-CreateVolumesFromSnapshotTest-1058140897 None] Volume volume-b49ebdb9-fcd0-49de-ae28-ded14bb6b21b (b49ebdb9-fcd0-49de-ae28-ded14bb6b21b): created successfully
Feb 28 04:49:14 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-20207fba-16cc-48b2-9249-76a83fb1ecfb tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dd5abf5-b366-43f8-a7eb-0adc5e9e716e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:14 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-20207fba-16cc-48b2-9249-76a83fb1ecfb tempest-CreateVolumesFromSnapshotTest-1058140897 None] Flow 'volume_create_manager' (f7642443-4e0a-49d9-acec-269b4b6eaef6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:49:14 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-20207fba-16cc-48b2-9249-76a83fb1ecfb tempest-CreateVolumesFromSnapshotTest-1058140897 None] Created volume successfully.
Feb 28 04:49:14 devstack sudo[90910]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-781970cd-52ba-4f83-8f37-7f62d77dd0c8 tempest-CreateVolumesFromSnapshotTest-1058140897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b94e70cc-45e4-4243-b0e7-f42852b6200f 1073741824" returned: 0 in 0.471s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-781970cd-52ba-4f83-8f37-7f62d77dd0c8 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b94e70cc-45e4-4243-b0e7-f42852b6200f {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:14 devstack sudo[90915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b94e70cc-45e4-4243-b0e7-f42852b6200f
Feb 28 04:49:14 devstack sudo[90915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:15 devstack sudo[90915]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-781970cd-52ba-4f83-8f37-7f62d77dd0c8 tempest-CreateVolumesFromSnapshotTest-1058140897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b94e70cc-45e4-4243-b0e7-f42852b6200f" returned: 0 in 0.399s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:15 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-781970cd-52ba-4f83-8f37-7f62d77dd0c8 tempest-CreateVolumesFromSnapshotTest-1058140897 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:49:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-781970cd-52ba-4f83-8f37-7f62d77dd0c8 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:49:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-01089e23-db92-4ec7-ae5a-a577959a4aad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.998s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:49:15 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-01089e23-db92-4ec7-ae5a-a577959a4aad tempest-CreateVolumesFromSnapshotTest-1058140897 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1575822787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=052cd19f-d459-4510-9ca6-51f437accd33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2983832994c463bb9db10c54fccabf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:49:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:49:12Z,use_quota=True,user_id='245ce12dddf44c9f88e59a857d94a904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:49:15 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-01089e23-db92-4ec7-ae5a-a577959a4aad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Creating volume 052cd19f-d459-4510-9ca6-51f437accd33 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:49:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-01089e23-db92-4ec7-ae5a-a577959a4aad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:49:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-01089e23-db92-4ec7-ae5a-a577959a4aad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:49:15 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-01089e23-db92-4ec7-ae5a-a577959a4aad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:49:15 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-01089e23-db92-4ec7-ae5a-a577959a4aad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:49:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-01089e23-db92-4ec7-ae5a-a577959a4aad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:49:15 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-01089e23-db92-4ec7-ae5a-a577959a4aad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:49:15 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-01089e23-db92-4ec7-ae5a-a577959a4aad tempest-CreateVolumesFromSnapshotTest-1058140897 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:49:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-01089e23-db92-4ec7-ae5a-a577959a4aad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-052cd19f-d459-4510-9ca6-51f437accd33 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:15 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-781970cd-52ba-4f83-8f37-7f62d77dd0c8 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ef8f5ed-c5ad-4f6b-bc18-a668cb8ce55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b94e70cc-45e4-4243-b0e7-f42852b6200f', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:15 devstack sudo[90918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-052cd19f-d459-4510-9ca6-51f437accd33 1073741824
Feb 28 04:49:15 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-781970cd-52ba-4f83-8f37-7f62d77dd0c8 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91513602-b6a9-4326-892c-0995ee1c4422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:15 devstack sudo[90918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:15 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-781970cd-52ba-4f83-8f37-7f62d77dd0c8 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Volume volume-b94e70cc-45e4-4243-b0e7-f42852b6200f (b94e70cc-45e4-4243-b0e7-f42852b6200f): created successfully
Feb 28 04:49:15 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-781970cd-52ba-4f83-8f37-7f62d77dd0c8 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91513602-b6a9-4326-892c-0995ee1c4422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:15 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-781970cd-52ba-4f83-8f37-7f62d77dd0c8 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Flow 'volume_create_manager' (69f1fb41-88c8-4a21-b85f-38db46ae866d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:49:15 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-781970cd-52ba-4f83-8f37-7f62d77dd0c8 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Created volume successfully.
Feb 28 04:49:15 devstack sudo[90918]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-01089e23-db92-4ec7-ae5a-a577959a4aad tempest-CreateVolumesFromSnapshotTest-1058140897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-052cd19f-d459-4510-9ca6-51f437accd33 1073741824" returned: 0 in 0.485s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-01089e23-db92-4ec7-ae5a-a577959a4aad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-052cd19f-d459-4510-9ca6-51f437accd33 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:15 devstack sudo[90925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-052cd19f-d459-4510-9ca6-51f437accd33
Feb 28 04:49:15 devstack sudo[90925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:15 devstack sudo[90925]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-01089e23-db92-4ec7-ae5a-a577959a4aad tempest-CreateVolumesFromSnapshotTest-1058140897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-052cd19f-d459-4510-9ca6-51f437accd33" returned: 0 in 0.428s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:15 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-01089e23-db92-4ec7-ae5a-a577959a4aad tempest-CreateVolumesFromSnapshotTest-1058140897 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:49:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-01089e23-db92-4ec7-ae5a-a577959a4aad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:49:15 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-01089e23-db92-4ec7-ae5a-a577959a4aad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (659fb25a-a0a2-40ff-a8a3-5102d67ff364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-052cd19f-d459-4510-9ca6-51f437accd33', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:15 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-01089e23-db92-4ec7-ae5a-a577959a4aad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74c59546-d2e5-4af4-84d8-409d7bfad1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:16 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-01089e23-db92-4ec7-ae5a-a577959a4aad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Volume volume-052cd19f-d459-4510-9ca6-51f437accd33 (052cd19f-d459-4510-9ca6-51f437accd33): created successfully
Feb 28 04:49:16 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-01089e23-db92-4ec7-ae5a-a577959a4aad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74c59546-d2e5-4af4-84d8-409d7bfad1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:16 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-01089e23-db92-4ec7-ae5a-a577959a4aad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Flow 'volume_create_manager' (ad1fcf78-5df7-4542-baaf-7314feddf061) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:49:16 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-01089e23-db92-4ec7-ae5a-a577959a4aad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Created volume successfully.
Feb 28 04:49:16 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-77214fa4-bea2-47b5-bf0e-3b41f3bf7efa tempest-CreateVolumesFromSnapshotTest-1058140897 None] Acquiring lock "cinder-052cd19f-d459-4510-9ca6-51f437accd33-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:49:16 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-77214fa4-bea2-47b5-bf0e-3b41f3bf7efa tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "cinder-052cd19f-d459-4510-9ca6-51f437accd33-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:49:16 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-77214fa4-bea2-47b5-bf0e-3b41f3bf7efa tempest-CreateVolumesFromSnapshotTest-1058140897 None] Acquiring lock "cinder-quobyte-052cd19f-d459-4510-9ca6-51f437accd33" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:49:16 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-77214fa4-bea2-47b5-bf0e-3b41f3bf7efa tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "cinder-quobyte-052cd19f-d459-4510-9ca6-51f437accd33" acquired by "delete_volume" :: waited 0.009s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:49:16 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe9603f-aceb-4aad-a9b8-754f91770315]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:49:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-77214fa4-bea2-47b5-bf0e-3b41f3bf7efa tempest-CreateVolumesFromSnapshotTest-1058140897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-052cd19f-d459-4510-9ca6-51f437accd33 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:16 devstack sudo[90928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-052cd19f-d459-4510-9ca6-51f437accd33
Feb 28 04:49:16 devstack sudo[90928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:16 devstack sudo[90928]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-77214fa4-bea2-47b5-bf0e-3b41f3bf7efa tempest-CreateVolumesFromSnapshotTest-1058140897 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-052cd19f-d459-4510-9ca6-51f437accd33" returned: 0 in 0.466s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-77214fa4-bea2-47b5-bf0e-3b41f3bf7efa tempest-CreateVolumesFromSnapshotTest-1058140897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-052cd19f-d459-4510-9ca6-51f437accd33 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:16 devstack sudo[90933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-052cd19f-d459-4510-9ca6-51f437accd33
Feb 28 04:49:16 devstack sudo[90933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:17 devstack sudo[90933]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-77214fa4-bea2-47b5-bf0e-3b41f3bf7efa tempest-CreateVolumesFromSnapshotTest-1058140897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-052cd19f-d459-4510-9ca6-51f437accd33" returned: 0 in 0.396s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:17 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-77214fa4-bea2-47b5-bf0e-3b41f3bf7efa tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "cinder-quobyte-052cd19f-d459-4510-9ca6-51f437accd33" released by "delete_volume" :: held 0.886s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:49:17 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-77214fa4-bea2-47b5-bf0e-3b41f3bf7efa tempest-CreateVolumesFromSnapshotTest-1058140897 None] Created reservations ['37b2472e-e008-481f-91b5-b2df578cf265', '80352ffc-ef15-475b-845c-a0bafc3f39a8', 'de76fc0d-fb1a-434e-a5fd-c9c5f777090e', 'ce06821c-edb3-444a-8465-ba17355efab6'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:49:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-77214fa4-bea2-47b5-bf0e-3b41f3bf7efa tempest-CreateVolumesFromSnapshotTest-1058140897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:49:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-77214fa4-bea2-47b5-bf0e-3b41f3bf7efa tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:49:17 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-77214fa4-bea2-47b5-bf0e-3b41f3bf7efa tempest-CreateVolumesFromSnapshotTest-1058140897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:49:17 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-77214fa4-bea2-47b5-bf0e-3b41f3bf7efa tempest-CreateVolumesFromSnapshotTest-1058140897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:49:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-77214fa4-bea2-47b5-bf0e-3b41f3bf7efa tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:49:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-77214fa4-bea2-47b5-bf0e-3b41f3bf7efa tempest-CreateVolumesFromSnapshotTest-1058140897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:17 devstack sudo[90936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:49:17 devstack sudo[90936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:17 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-9f94ffad-7ac5-42dd-9253-4fbaa2bbc761 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Acquiring lock "cinder-b94e70cc-45e4-4243-b0e7-f42852b6200f-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:49:17 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-9f94ffad-7ac5-42dd-9253-4fbaa2bbc761 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "cinder-b94e70cc-45e4-4243-b0e7-f42852b6200f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:49:17 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-9f94ffad-7ac5-42dd-9253-4fbaa2bbc761 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Acquiring lock "cinder-quobyte-b94e70cc-45e4-4243-b0e7-f42852b6200f" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:49:17 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-9f94ffad-7ac5-42dd-9253-4fbaa2bbc761 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "cinder-quobyte-b94e70cc-45e4-4243-b0e7-f42852b6200f" acquired by "delete_volume" :: waited 0.008s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:49:17 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fd2824-8169-4c6e-a6ba-280cdf2d0c4a]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:49:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9f94ffad-7ac5-42dd-9253-4fbaa2bbc761 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b94e70cc-45e4-4243-b0e7-f42852b6200f {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:17 devstack sudo[90938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b94e70cc-45e4-4243-b0e7-f42852b6200f
Feb 28 04:49:17 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:17 devstack sudo[90936]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-77214fa4-bea2-47b5-bf0e-3b41f3bf7efa tempest-CreateVolumesFromSnapshotTest-1058140897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.420s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:17 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-77214fa4-bea2-47b5-bf0e-3b41f3bf7efa tempest-CreateVolumesFromSnapshotTest-1058140897 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:49:17 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-77214fa4-bea2-47b5-bf0e-3b41f3bf7efa tempest-CreateVolumesFromSnapshotTest-1058140897 None] Deleted volume successfully.
Feb 28 04:49:17 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-77214fa4-bea2-47b5-bf0e-3b41f3bf7efa tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "cinder-052cd19f-d459-4510-9ca6-51f437accd33-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:49:18 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9f94ffad-7ac5-42dd-9253-4fbaa2bbc761 tempest-CreateVolumesFromSnapshotTest-1058140897 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b94e70cc-45e4-4243-b0e7-f42852b6200f" returned: 0 in 0.468s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9f94ffad-7ac5-42dd-9253-4fbaa2bbc761 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b94e70cc-45e4-4243-b0e7-f42852b6200f {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:18 devstack sudo[90944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b94e70cc-45e4-4243-b0e7-f42852b6200f
Feb 28 04:49:18 devstack sudo[90944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:18 devstack sudo[90944]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9f94ffad-7ac5-42dd-9253-4fbaa2bbc761 tempest-CreateVolumesFromSnapshotTest-1058140897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b94e70cc-45e4-4243-b0e7-f42852b6200f" returned: 0 in 0.411s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:18 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-9f94ffad-7ac5-42dd-9253-4fbaa2bbc761 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "cinder-quobyte-b94e70cc-45e4-4243-b0e7-f42852b6200f" released by "delete_volume" :: held 0.902s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:49:18 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-9f94ffad-7ac5-42dd-9253-4fbaa2bbc761 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Created reservations ['9d717ea6-7a52-4ec1-9cbc-2f6c56b82279', '4a8e6553-f9b0-417f-9e1f-39f1f9d819b3', '5731cc0b-87f9-4162-84f0-e6562bcc7c69', '542783dc-0156-46b4-bca1-7e93719f04bc'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:49:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-9f94ffad-7ac5-42dd-9253-4fbaa2bbc761 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:49:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-9f94ffad-7ac5-42dd-9253-4fbaa2bbc761 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:49:18 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-9f94ffad-7ac5-42dd-9253-4fbaa2bbc761 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:49:18 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-9f94ffad-7ac5-42dd-9253-4fbaa2bbc761 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:49:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-9f94ffad-7ac5-42dd-9253-4fbaa2bbc761 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:49:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9f94ffad-7ac5-42dd-9253-4fbaa2bbc761 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:18 devstack sudo[90981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:49:18 devstack sudo[90981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:18 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6d0b5c94-0303-4a06-b8e8-202fe8384212 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Acquiring lock "cinder-b49ebdb9-fcd0-49de-ae28-ded14bb6b21b-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:49:18 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6d0b5c94-0303-4a06-b8e8-202fe8384212 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "cinder-b49ebdb9-fcd0-49de-ae28-ded14bb6b21b-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:49:18 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6d0b5c94-0303-4a06-b8e8-202fe8384212 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Acquiring lock "cinder-quobyte-b49ebdb9-fcd0-49de-ae28-ded14bb6b21b" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:49:18 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6d0b5c94-0303-4a06-b8e8-202fe8384212 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "cinder-quobyte-b49ebdb9-fcd0-49de-ae28-ded14bb6b21b" acquired by "delete_volume" :: waited 0.009s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:49:18 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99be5b7-4b1c-4e94-90ae-52dfe55e4c70]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:49:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6d0b5c94-0303-4a06-b8e8-202fe8384212 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b49ebdb9-fcd0-49de-ae28-ded14bb6b21b {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:18 devstack sudo[90983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b49ebdb9-fcd0-49de-ae28-ded14bb6b21b
Feb 28 04:49:18 devstack sudo[90983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:18 devstack sudo[90981]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9f94ffad-7ac5-42dd-9253-4fbaa2bbc761 tempest-CreateVolumesFromSnapshotTest-1058140897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.430s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:18 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-9f94ffad-7ac5-42dd-9253-4fbaa2bbc761 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:49:18 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-9f94ffad-7ac5-42dd-9253-4fbaa2bbc761 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Deleted volume successfully.
Feb 28 04:49:18 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-9f94ffad-7ac5-42dd-9253-4fbaa2bbc761 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "cinder-b94e70cc-45e4-4243-b0e7-f42852b6200f-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:49:19 devstack sudo[90983]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6d0b5c94-0303-4a06-b8e8-202fe8384212 tempest-CreateVolumesFromSnapshotTest-1058140897 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b49ebdb9-fcd0-49de-ae28-ded14bb6b21b" returned: 0 in 0.477s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6d0b5c94-0303-4a06-b8e8-202fe8384212 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b49ebdb9-fcd0-49de-ae28-ded14bb6b21b {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:19 devstack sudo[90989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b49ebdb9-fcd0-49de-ae28-ded14bb6b21b
Feb 28 04:49:19 devstack sudo[90989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:19 devstack sudo[90989]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6d0b5c94-0303-4a06-b8e8-202fe8384212 tempest-CreateVolumesFromSnapshotTest-1058140897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b49ebdb9-fcd0-49de-ae28-ded14bb6b21b" returned: 0 in 0.399s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:19 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6d0b5c94-0303-4a06-b8e8-202fe8384212 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "cinder-quobyte-b49ebdb9-fcd0-49de-ae28-ded14bb6b21b" released by "delete_volume" :: held 0.898s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:49:19 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-6d0b5c94-0303-4a06-b8e8-202fe8384212 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Created reservations ['e082bd95-d903-4dc1-abd5-f4f34b13976e', '9bda7673-2916-456d-a30d-a14626fa4a78', '98d2833c-93ff-40b0-8e51-8c3de27f80d3', '651ee636-f7a6-4fb9-8882-d344583f51be'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:49:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-6d0b5c94-0303-4a06-b8e8-202fe8384212 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:49:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-6d0b5c94-0303-4a06-b8e8-202fe8384212 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:49:19 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-6d0b5c94-0303-4a06-b8e8-202fe8384212 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:49:19 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-6d0b5c94-0303-4a06-b8e8-202fe8384212 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:49:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-6d0b5c94-0303-4a06-b8e8-202fe8384212 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:49:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6d0b5c94-0303-4a06-b8e8-202fe8384212 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:19 devstack sudo[90998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:49:19 devstack sudo[90998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:19 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-b7ca7892-fee9-4bab-88b2-57c4c52e63ad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Acquiring lock "cinder-4460180b-ddfd-4ff7-ba2e-94e6df0f8d89-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:49:19 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-b7ca7892-fee9-4bab-88b2-57c4c52e63ad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "cinder-4460180b-ddfd-4ff7-ba2e-94e6df0f8d89-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:49:19 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-b7ca7892-fee9-4bab-88b2-57c4c52e63ad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Acquiring lock "cinder-quobyte-4460180b-ddfd-4ff7-ba2e-94e6df0f8d89" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:49:19 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-b7ca7892-fee9-4bab-88b2-57c4c52e63ad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "cinder-quobyte-4460180b-ddfd-4ff7-ba2e-94e6df0f8d89" acquired by "delete_volume" :: waited 0.008s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:49:19 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4a06ba-15cb-4b26-affa-fc852559963b]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:49:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b7ca7892-fee9-4bab-88b2-57c4c52e63ad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4460180b-ddfd-4ff7-ba2e-94e6df0f8d89 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:19 devstack sudo[91001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4460180b-ddfd-4ff7-ba2e-94e6df0f8d89
Feb 28 04:49:19 devstack sudo[91001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:20 devstack sudo[90998]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6d0b5c94-0303-4a06-b8e8-202fe8384212 tempest-CreateVolumesFromSnapshotTest-1058140897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.436s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:20 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-6d0b5c94-0303-4a06-b8e8-202fe8384212 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:49:20 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-6d0b5c94-0303-4a06-b8e8-202fe8384212 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Deleted volume successfully.
Feb 28 04:49:20 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6d0b5c94-0303-4a06-b8e8-202fe8384212 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "cinder-b49ebdb9-fcd0-49de-ae28-ded14bb6b21b-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:49:20 devstack sudo[91001]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b7ca7892-fee9-4bab-88b2-57c4c52e63ad tempest-CreateVolumesFromSnapshotTest-1058140897 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4460180b-ddfd-4ff7-ba2e-94e6df0f8d89" returned: 0 in 0.459s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b7ca7892-fee9-4bab-88b2-57c4c52e63ad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4460180b-ddfd-4ff7-ba2e-94e6df0f8d89 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:20 devstack sudo[91007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4460180b-ddfd-4ff7-ba2e-94e6df0f8d89
Feb 28 04:49:20 devstack sudo[91007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:20 devstack sudo[91007]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b7ca7892-fee9-4bab-88b2-57c4c52e63ad tempest-CreateVolumesFromSnapshotTest-1058140897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4460180b-ddfd-4ff7-ba2e-94e6df0f8d89" returned: 0 in 0.399s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:20 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-b7ca7892-fee9-4bab-88b2-57c4c52e63ad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "cinder-quobyte-4460180b-ddfd-4ff7-ba2e-94e6df0f8d89" released by "delete_volume" :: held 0.880s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:49:20 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-b7ca7892-fee9-4bab-88b2-57c4c52e63ad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Created reservations ['f142a4be-6e1a-4272-aa80-982698b1e383', '6f3152af-0969-49a5-b1a0-34d221e013e6', '8f35352c-ed19-4be0-9a41-154d1a2f1873', 'f0b5688d-b440-4d47-bfa8-c421351b369d'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:49:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b7ca7892-fee9-4bab-88b2-57c4c52e63ad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:49:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b7ca7892-fee9-4bab-88b2-57c4c52e63ad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:49:20 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-b7ca7892-fee9-4bab-88b2-57c4c52e63ad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:49:20 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-b7ca7892-fee9-4bab-88b2-57c4c52e63ad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:49:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b7ca7892-fee9-4bab-88b2-57c4c52e63ad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:49:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b7ca7892-fee9-4bab-88b2-57c4c52e63ad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:20 devstack sudo[91010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:49:20 devstack sudo[91010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:20 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1ac08ea0-58db-4c0e-ad6e-93ac93283ff6 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Acquiring lock "cinder-94585c52-bcac-4d62-af13-52032ed3eb49-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:49:20 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1ac08ea0-58db-4c0e-ad6e-93ac93283ff6 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "cinder-94585c52-bcac-4d62-af13-52032ed3eb49-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:49:20 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1ac08ea0-58db-4c0e-ad6e-93ac93283ff6 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Acquiring lock "cinder-quobyte-94585c52-bcac-4d62-af13-52032ed3eb49" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:49:20 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1ac08ea0-58db-4c0e-ad6e-93ac93283ff6 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "cinder-quobyte-94585c52-bcac-4d62-af13-52032ed3eb49" acquired by "delete_volume" :: waited 0.011s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:49:20 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[143160d9-74a2-4e32-ba74-13e4deefb097]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:49:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1ac08ea0-58db-4c0e-ad6e-93ac93283ff6 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-94585c52-bcac-4d62-af13-52032ed3eb49 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:20 devstack sudo[91012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-94585c52-bcac-4d62-af13-52032ed3eb49
Feb 28 04:49:20 devstack sudo[91012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:21 devstack sudo[91010]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b7ca7892-fee9-4bab-88b2-57c4c52e63ad tempest-CreateVolumesFromSnapshotTest-1058140897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.423s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:21 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-b7ca7892-fee9-4bab-88b2-57c4c52e63ad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:49:21 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-b7ca7892-fee9-4bab-88b2-57c4c52e63ad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Deleted volume successfully.
Feb 28 04:49:21 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-b7ca7892-fee9-4bab-88b2-57c4c52e63ad tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "cinder-4460180b-ddfd-4ff7-ba2e-94e6df0f8d89-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:49:21 devstack sudo[91012]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1ac08ea0-58db-4c0e-ad6e-93ac93283ff6 tempest-CreateVolumesFromSnapshotTest-1058140897 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-94585c52-bcac-4d62-af13-52032ed3eb49" returned: 0 in 0.461s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1ac08ea0-58db-4c0e-ad6e-93ac93283ff6 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-94585c52-bcac-4d62-af13-52032ed3eb49 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:21 devstack sudo[91018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-94585c52-bcac-4d62-af13-52032ed3eb49
Feb 28 04:49:21 devstack sudo[91018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:21 devstack sudo[91018]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1ac08ea0-58db-4c0e-ad6e-93ac93283ff6 tempest-CreateVolumesFromSnapshotTest-1058140897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-94585c52-bcac-4d62-af13-52032ed3eb49" returned: 0 in 0.391s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:21 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1ac08ea0-58db-4c0e-ad6e-93ac93283ff6 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "cinder-quobyte-94585c52-bcac-4d62-af13-52032ed3eb49" released by "delete_volume" :: held 0.874s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:49:21 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-1ac08ea0-58db-4c0e-ad6e-93ac93283ff6 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Created reservations ['c5d7dc02-8e4d-4067-a24d-964bade7aea6', '16507185-5ee9-4ec8-a504-11878075910f', '337c74d7-370b-4d85-9dc5-7d4cd2b8ef3e', '8bd0342c-d490-4148-808e-86cf475ef7ae'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:49:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-1ac08ea0-58db-4c0e-ad6e-93ac93283ff6 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:49:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-1ac08ea0-58db-4c0e-ad6e-93ac93283ff6 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:49:21 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-1ac08ea0-58db-4c0e-ad6e-93ac93283ff6 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:49:21 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-1ac08ea0-58db-4c0e-ad6e-93ac93283ff6 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:49:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-1ac08ea0-58db-4c0e-ad6e-93ac93283ff6 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:49:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1ac08ea0-58db-4c0e-ad6e-93ac93283ff6 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:21 devstack sudo[91021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:49:21 devstack sudo[91021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:21 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6d2a4494-bd2c-4708-b088-c9cec6297686 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Acquiring lock "cinder-76a17495-89e1-4d49-8d29-5faaa59e0cfb-delete_snapshot" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:49:21 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6d2a4494-bd2c-4708-b088-c9cec6297686 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "cinder-76a17495-89e1-4d49-8d29-5faaa59e0cfb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:49:21 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6d2a4494-bd2c-4708-b088-c9cec6297686 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Acquiring lock "cinder-quobyte-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:49:21 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6d2a4494-bd2c-4708-b088-c9cec6297686 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "cinder-quobyte-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4" acquired by "delete_snapshot" :: waited 0.012s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:49:21 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6d2a4494-bd2c-4708-b088-c9cec6297686 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Acquiring lock "cinder-quobyte-76a17495-89e1-4d49-8d29-5faaa59e0cfb" by "_delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:49:21 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6d2a4494-bd2c-4708-b088-c9cec6297686 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "cinder-quobyte-76a17495-89e1-4d49-8d29-5faaa59e0cfb" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:49:21 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-6d2a4494-bd2c-4708-b088-c9cec6297686 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Deleting offline snapshot 76a17495-89e1-4d49-8d29-5faaa59e0cfb of volume ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4 {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 04:49:21 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-6d2a4494-bd2c-4708-b088-c9cec6297686 tempest-CreateVolumesFromSnapshotTest-1058140897 None] snapshot_file for this snap is: volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4.76a17495-89e1-4d49-8d29-5faaa59e0cfb {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 04:49:22 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[028662b3-2d40-4bb4-99b0-1447c50a1a0f]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:49:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6d2a4494-bd2c-4708-b088-c9cec6297686 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4.76a17495-89e1-4d49-8d29-5faaa59e0cfb {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:22 devstack sudo[91023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4.76a17495-89e1-4d49-8d29-5faaa59e0cfb
Feb 28 04:49:22 devstack sudo[91023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:22 devstack sudo[91021]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1ac08ea0-58db-4c0e-ad6e-93ac93283ff6 tempest-CreateVolumesFromSnapshotTest-1058140897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.422s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:22 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-1ac08ea0-58db-4c0e-ad6e-93ac93283ff6 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:49:22 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-1ac08ea0-58db-4c0e-ad6e-93ac93283ff6 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Deleted volume successfully.
Feb 28 04:49:22 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1ac08ea0-58db-4c0e-ad6e-93ac93283ff6 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "cinder-94585c52-bcac-4d62-af13-52032ed3eb49-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:49:22 devstack sudo[91023]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6d2a4494-bd2c-4708-b088-c9cec6297686 tempest-CreateVolumesFromSnapshotTest-1058140897 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4.76a17495-89e1-4d49-8d29-5faaa59e0cfb" returned: 0 in 0.484s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:22 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-6d2a4494-bd2c-4708-b088-c9cec6297686 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:49:22 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bafb688-e6ba-43d2-9b8b-39dbbcb66681]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:49:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6d2a4494-bd2c-4708-b088-c9cec6297686 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:22 devstack sudo[91029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4
Feb 28 04:49:22 devstack sudo[91029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:22 devstack sudo[91029]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6d2a4494-bd2c-4708-b088-c9cec6297686 tempest-CreateVolumesFromSnapshotTest-1058140897 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4" returned: 0 in 0.462s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6d2a4494-bd2c-4708-b088-c9cec6297686 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4.76a17495-89e1-4d49-8d29-5faaa59e0cfb {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:22 devstack sudo[91034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4.76a17495-89e1-4d49-8d29-5faaa59e0cfb
Feb 28 04:49:22 devstack sudo[91034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:23 devstack sudo[91034]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6d2a4494-bd2c-4708-b088-c9cec6297686 tempest-CreateVolumesFromSnapshotTest-1058140897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4.76a17495-89e1-4d49-8d29-5faaa59e0cfb" returned: 0 in 0.436s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6d2a4494-bd2c-4708-b088-c9cec6297686 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4.76a17495-89e1-4d49-8d29-5faaa59e0cfb {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:23 devstack sudo[91039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4.76a17495-89e1-4d49-8d29-5faaa59e0cfb
Feb 28 04:49:23 devstack sudo[91039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:23 devstack sudo[91039]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6d2a4494-bd2c-4708-b088-c9cec6297686 tempest-CreateVolumesFromSnapshotTest-1058140897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4.76a17495-89e1-4d49-8d29-5faaa59e0cfb" returned: 0 in 0.399s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:23 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6d2a4494-bd2c-4708-b088-c9cec6297686 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "cinder-quobyte-76a17495-89e1-4d49-8d29-5faaa59e0cfb" released by "_delete_snapshot" :: held 1.839s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:49:23 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6d2a4494-bd2c-4708-b088-c9cec6297686 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "cinder-quobyte-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4" released by "delete_snapshot" :: held 1.856s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:49:23 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-6d2a4494-bd2c-4708-b088-c9cec6297686 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Created reservations ['9b2b5286-87b3-47b8-a707-e84d984ddce1', '483eb246-f488-4c92-8407-7ec5fdc70d85', '99d391e8-0e3e-486d-a614-1f58ec20aafa', '61309ad1-c491-4c56-995f-b01c606cf0fc'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:49:23 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-6d2a4494-bd2c-4708-b088-c9cec6297686 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Delete snapshot completed successfully.
Feb 28 04:49:23 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6d2a4494-bd2c-4708-b088-c9cec6297686 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "cinder-76a17495-89e1-4d49-8d29-5faaa59e0cfb-delete_snapshot" released by "delete_snapshot" :: held 1.939s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:49:24 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8881a0c9-2ee2-4702-a890-a1ee94591292 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Acquiring lock "cinder-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:49:24 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8881a0c9-2ee2-4702-a890-a1ee94591292 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "cinder-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:49:24 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8881a0c9-2ee2-4702-a890-a1ee94591292 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Acquiring lock "cinder-quobyte-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:49:24 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8881a0c9-2ee2-4702-a890-a1ee94591292 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "cinder-quobyte-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4" acquired by "delete_volume" :: waited 0.009s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:49:24 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[9762da6f-d302-428c-a36d-298a5aeea650]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:49:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8881a0c9-2ee2-4702-a890-a1ee94591292 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:24 devstack sudo[91042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4
Feb 28 04:49:24 devstack sudo[91042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:24 devstack cinder-volume[84248]: DEBUG oslo_service.periodic_task [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84248) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 28 04:49:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:49:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:49:24 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:49:24 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:49:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:49:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:24 devstack sudo[91042]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8881a0c9-2ee2-4702-a890-a1ee94591292 tempest-CreateVolumesFromSnapshotTest-1058140897 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4" returned: 0 in 0.467s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:24 devstack sudo[91047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:49:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8881a0c9-2ee2-4702-a890-a1ee94591292 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:24 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:24 devstack sudo[91049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4
Feb 28 04:49:24 devstack sudo[91049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:24 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.398s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:24 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:49:25 devstack sudo[91049]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8881a0c9-2ee2-4702-a890-a1ee94591292 tempest-CreateVolumesFromSnapshotTest-1058140897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4" returned: 0 in 0.407s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:25 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8881a0c9-2ee2-4702-a890-a1ee94591292 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "cinder-quobyte-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4" released by "delete_volume" :: held 0.904s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:49:25 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-8881a0c9-2ee2-4702-a890-a1ee94591292 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Created reservations ['c4111d20-1ce7-4429-b285-f33480eb7f28', '6a0626ce-0ae8-4a3b-9966-79b614fba3e4', 'ae82460b-e3be-4626-8567-f637edb2267b', 'bf47b1d6-4f19-4dec-905e-0149fed3bcad'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:49:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-8881a0c9-2ee2-4702-a890-a1ee94591292 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:49:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-8881a0c9-2ee2-4702-a890-a1ee94591292 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:49:25 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-8881a0c9-2ee2-4702-a890-a1ee94591292 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:49:25 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-8881a0c9-2ee2-4702-a890-a1ee94591292 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:49:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-8881a0c9-2ee2-4702-a890-a1ee94591292 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:49:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8881a0c9-2ee2-4702-a890-a1ee94591292 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:25 devstack sudo[91053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:49:25 devstack sudo[91053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:25 devstack sudo[91053]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8881a0c9-2ee2-4702-a890-a1ee94591292 tempest-CreateVolumesFromSnapshotTest-1058140897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.444s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:25 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-8881a0c9-2ee2-4702-a890-a1ee94591292 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:49:25 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-8881a0c9-2ee2-4702-a890-a1ee94591292 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Deleted volume successfully.
Feb 28 04:49:25 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8881a0c9-2ee2-4702-a890-a1ee94591292 tempest-CreateVolumesFromSnapshotTest-1058140897 None] Lock "cinder-ee3df7b4-5f3e-4a7c-bd05-7183ff98bff4-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:49:26 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-07437a37-423b-4dcd-b239-179e9156cebe tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:49:26 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-07437a37-423b-4dcd-b239-179e9156cebe tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Flow 'volume_create_manager' (ee1ad872-938c-4647-aa83-5baeceade96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:49:26 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-07437a37-423b-4dcd-b239-179e9156cebe tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7162990-56d3-426d-8845-a950188b32f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:26 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-07437a37-423b-4dcd-b239-179e9156cebe tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7162990-56d3-426d-8845-a950188b32f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-719838151',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0563fb4-ff22-4345-9410-9f6c59135a67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06766b64e76446a9ab73bb4cc2c8a253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:49:27Z,use_quota=True,user_id='b98304b8951147e89fedc088b049a089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:26 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-07437a37-423b-4dcd-b239-179e9156cebe tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6217d30a-5906-46e6-b195-c18559e98d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:26 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-07437a37-423b-4dcd-b239-179e9156cebe tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6217d30a-5906-46e6-b195-c18559e98d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:26 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-07437a37-423b-4dcd-b239-179e9156cebe tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81243214-0ebb-4c59-b899-7cc1df2fd0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:26 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-07437a37-423b-4dcd-b239-179e9156cebe tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81243214-0ebb-4c59-b899-7cc1df2fd0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0563fb4-ff22-4345-9410-9f6c59135a67', 'volume_name': 'volume-b0563fb4-ff22-4345-9410-9f6c59135a67', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:26 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-07437a37-423b-4dcd-b239-179e9156cebe tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97761ec3-06f7-4119-b1eb-2c242ac516c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:26 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-07437a37-423b-4dcd-b239-179e9156cebe tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97761ec3-06f7-4119-b1eb-2c242ac516c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:26 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-07437a37-423b-4dcd-b239-179e9156cebe tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d694d685-cf59-4d21-a25b-57629c0ce6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:26 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-07437a37-423b-4dcd-b239-179e9156cebe tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Volume b0563fb4-ff22-4345-9410-9f6c59135a67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0563fb4-ff22-4345-9410-9f6c59135a67', 'volume_size': 1}
Feb 28 04:49:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-07437a37-423b-4dcd-b239-179e9156cebe tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:49:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-07437a37-423b-4dcd-b239-179e9156cebe tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:49:26 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-07437a37-423b-4dcd-b239-179e9156cebe tempest-CreateVolumesFromSourceVolumeTest-129109169 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-719838151',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0563fb4-ff22-4345-9410-9f6c59135a67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06766b64e76446a9ab73bb4cc2c8a253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:49:27Z,use_quota=True,user_id='b98304b8951147e89fedc088b049a089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:49:26 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-07437a37-423b-4dcd-b239-179e9156cebe tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Creating volume b0563fb4-ff22-4345-9410-9f6c59135a67 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:49:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-07437a37-423b-4dcd-b239-179e9156cebe tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:49:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-07437a37-423b-4dcd-b239-179e9156cebe tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:49:26 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-07437a37-423b-4dcd-b239-179e9156cebe tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:49:26 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-07437a37-423b-4dcd-b239-179e9156cebe tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:49:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-07437a37-423b-4dcd-b239-179e9156cebe tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:49:26 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-07437a37-423b-4dcd-b239-179e9156cebe tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:49:26 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-07437a37-423b-4dcd-b239-179e9156cebe tempest-CreateVolumesFromSourceVolumeTest-129109169 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:49:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-07437a37-423b-4dcd-b239-179e9156cebe tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b0563fb4-ff22-4345-9410-9f6c59135a67 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:26 devstack sudo[91057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b0563fb4-ff22-4345-9410-9f6c59135a67 1073741824
Feb 28 04:49:26 devstack sudo[91057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:27 devstack sudo[91057]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:27 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-07437a37-423b-4dcd-b239-179e9156cebe tempest-CreateVolumesFromSourceVolumeTest-129109169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b0563fb4-ff22-4345-9410-9f6c59135a67 1073741824" returned: 0 in 0.471s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:27 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-07437a37-423b-4dcd-b239-179e9156cebe tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b0563fb4-ff22-4345-9410-9f6c59135a67 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:27 devstack sudo[91062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b0563fb4-ff22-4345-9410-9f6c59135a67
Feb 28 04:49:27 devstack sudo[91062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:27 devstack sudo[91062]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:27 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-07437a37-423b-4dcd-b239-179e9156cebe tempest-CreateVolumesFromSourceVolumeTest-129109169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b0563fb4-ff22-4345-9410-9f6c59135a67" returned: 0 in 0.406s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:27 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-07437a37-423b-4dcd-b239-179e9156cebe tempest-CreateVolumesFromSourceVolumeTest-129109169 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:49:27 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-07437a37-423b-4dcd-b239-179e9156cebe tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:49:27 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-07437a37-423b-4dcd-b239-179e9156cebe tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d694d685-cf59-4d21-a25b-57629c0ce6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0563fb4-ff22-4345-9410-9f6c59135a67', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:27 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-07437a37-423b-4dcd-b239-179e9156cebe tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcc23ff2-e23d-470b-abe0-0ee8cdaea370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:27 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-07437a37-423b-4dcd-b239-179e9156cebe tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Volume volume-b0563fb4-ff22-4345-9410-9f6c59135a67 (b0563fb4-ff22-4345-9410-9f6c59135a67): created successfully
Feb 28 04:49:27 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-07437a37-423b-4dcd-b239-179e9156cebe tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcc23ff2-e23d-470b-abe0-0ee8cdaea370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:27 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-07437a37-423b-4dcd-b239-179e9156cebe tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Flow 'volume_create_manager' (ee1ad872-938c-4647-aa83-5baeceade96d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:49:27 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-07437a37-423b-4dcd-b239-179e9156cebe tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Created volume successfully.
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f8f8842-b7d1-4801-b55f-be01ca16c74d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6f8f8842-b7d1-4801-b55f-be01ca16c74d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Flow 'volume_create_manager' (625a5e06-e618-452a-8606-acf63dc46ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6f8f8842-b7d1-4801-b55f-be01ca16c74d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bba7b01-1cf2-4ad7-a108-85377150c187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6f8f8842-b7d1-4801-b55f-be01ca16c74d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bba7b01-1cf2-4ad7-a108-85377150c187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:49:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-393961483',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb68cbb0-4e52-4908-b0d6-9220b61c0f2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06766b64e76446a9ab73bb4cc2c8a253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:49:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:49:29Z,use_quota=True,user_id='b98304b8951147e89fedc088b049a089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6f8f8842-b7d1-4801-b55f-be01ca16c74d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f24c15-f0e1-4002-90da-cc8e650a1ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6f8f8842-b7d1-4801-b55f-be01ca16c74d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f24c15-f0e1-4002-90da-cc8e650a1ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6f8f8842-b7d1-4801-b55f-be01ca16c74d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feebf82c-4751-45b9-853b-174df6ba6c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6f8f8842-b7d1-4801-b55f-be01ca16c74d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feebf82c-4751-45b9-853b-174df6ba6c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb68cbb0-4e52-4908-b0d6-9220b61c0f2d', 'volume_name': 'volume-bb68cbb0-4e52-4908-b0d6-9220b61c0f2d', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6f8f8842-b7d1-4801-b55f-be01ca16c74d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (777e9684-c037-43eb-a1b3-c18e16c83b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6f8f8842-b7d1-4801-b55f-be01ca16c74d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (777e9684-c037-43eb-a1b3-c18e16c83b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6f8f8842-b7d1-4801-b55f-be01ca16c74d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d395dccd-4b20-4571-8b15-e140e238e169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:29 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-6f8f8842-b7d1-4801-b55f-be01ca16c74d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Volume bb68cbb0-4e52-4908-b0d6-9220b61c0f2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb68cbb0-4e52-4908-b0d6-9220b61c0f2d', 'volume_size': 1}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-6f8f8842-b7d1-4801-b55f-be01ca16c74d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-6f8f8842-b7d1-4801-b55f-be01ca16c74d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-6f8f8842-b7d1-4801-b55f-be01ca16c74d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:49:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-393961483',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb68cbb0-4e52-4908-b0d6-9220b61c0f2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06766b64e76446a9ab73bb4cc2c8a253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:49:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:49:29Z,use_quota=True,user_id='b98304b8951147e89fedc088b049a089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-6f8f8842-b7d1-4801-b55f-be01ca16c74d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Creating volume bb68cbb0-4e52-4908-b0d6-9220b61c0f2d {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-6f8f8842-b7d1-4801-b55f-be01ca16c74d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-6f8f8842-b7d1-4801-b55f-be01ca16c74d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-6f8f8842-b7d1-4801-b55f-be01ca16c74d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-6f8f8842-b7d1-4801-b55f-be01ca16c74d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-6f8f8842-b7d1-4801-b55f-be01ca16c74d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-6f8f8842-b7d1-4801-b55f-be01ca16c74d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:49:29 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-6f8f8842-b7d1-4801-b55f-be01ca16c74d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6f8f8842-b7d1-4801-b55f-be01ca16c74d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bb68cbb0-4e52-4908-b0d6-9220b61c0f2d 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:29 devstack sudo[91065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bb68cbb0-4e52-4908-b0d6-9220b61c0f2d 1073741824
Feb 28 04:49:29 devstack sudo[91065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-6201bfdd-6ebf-4870-9187-6a398e99f30a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6201bfdd-6ebf-4870-9187-6a398e99f30a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Flow 'volume_create_manager' (0536b01c-a355-4b5f-ac82-894065e2fa80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6201bfdd-6ebf-4870-9187-6a398e99f30a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8420d3e3-889b-43c5-994c-c1cbb7763fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6201bfdd-6ebf-4870-9187-6a398e99f30a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8420d3e3-889b-43c5-994c-c1cbb7763fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:49:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-781888360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28b99583-cb7c-4e3a-954b-60d71d7804e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06766b64e76446a9ab73bb4cc2c8a253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:49:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:49:29Z,use_quota=True,user_id='b98304b8951147e89fedc088b049a089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6201bfdd-6ebf-4870-9187-6a398e99f30a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aaf6c45-1cbb-4348-aa7c-b6595279e12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6201bfdd-6ebf-4870-9187-6a398e99f30a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aaf6c45-1cbb-4348-aa7c-b6595279e12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6201bfdd-6ebf-4870-9187-6a398e99f30a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d2e7d8e-080a-4a5a-9468-df3a27ba2e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6201bfdd-6ebf-4870-9187-6a398e99f30a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d2e7d8e-080a-4a5a-9468-df3a27ba2e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28b99583-cb7c-4e3a-954b-60d71d7804e6', 'volume_name': 'volume-28b99583-cb7c-4e3a-954b-60d71d7804e6', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6201bfdd-6ebf-4870-9187-6a398e99f30a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f71618a0-2c72-4872-99e8-9199167fcf70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6201bfdd-6ebf-4870-9187-6a398e99f30a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f71618a0-2c72-4872-99e8-9199167fcf70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6201bfdd-6ebf-4870-9187-6a398e99f30a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (536944b5-702b-4974-9fd5-b9e0e077a825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:29 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-6201bfdd-6ebf-4870-9187-6a398e99f30a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Volume 28b99583-cb7c-4e3a-954b-60d71d7804e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28b99583-cb7c-4e3a-954b-60d71d7804e6', 'volume_size': 1}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-6201bfdd-6ebf-4870-9187-6a398e99f30a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-b007543c-0c2c-4b3d-9e07-7cea69d4ead5 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b007543c-0c2c-4b3d-9e07-7cea69d4ead5 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Flow 'volume_create_manager' (6d36d1d6-ef9f-44a5-a568-f3eee9e8dcf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b007543c-0c2c-4b3d-9e07-7cea69d4ead5 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97ca6e51-c1a7-486c-8811-4402e8c33d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b007543c-0c2c-4b3d-9e07-7cea69d4ead5 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97ca6e51-c1a7-486c-8811-4402e8c33d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:49:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1515104844',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f872cc8-80b9-4530-b411-577325991c2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06766b64e76446a9ab73bb4cc2c8a253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:49:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:49:30Z,use_quota=True,user_id='b98304b8951147e89fedc088b049a089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b007543c-0c2c-4b3d-9e07-7cea69d4ead5 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b2f302d-f89d-42a4-b14f-7c7a09a8c495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b007543c-0c2c-4b3d-9e07-7cea69d4ead5 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b2f302d-f89d-42a4-b14f-7c7a09a8c495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b007543c-0c2c-4b3d-9e07-7cea69d4ead5 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30d09eb3-726e-425e-ad94-5b60f51f04c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b007543c-0c2c-4b3d-9e07-7cea69d4ead5 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30d09eb3-726e-425e-ad94-5b60f51f04c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f872cc8-80b9-4530-b411-577325991c2e', 'volume_name': 'volume-6f872cc8-80b9-4530-b411-577325991c2e', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b007543c-0c2c-4b3d-9e07-7cea69d4ead5 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e5d104e-f480-4b96-acf8-ef6f055fd38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b007543c-0c2c-4b3d-9e07-7cea69d4ead5 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e5d104e-f480-4b96-acf8-ef6f055fd38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b007543c-0c2c-4b3d-9e07-7cea69d4ead5 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5b06cad-473d-4752-96f8-be9b820eda10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:29 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-b007543c-0c2c-4b3d-9e07-7cea69d4ead5 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Volume 6f872cc8-80b9-4530-b411-577325991c2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f872cc8-80b9-4530-b411-577325991c2e', 'volume_size': 1}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b007543c-0c2c-4b3d-9e07-7cea69d4ead5 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-8052e8a9-038e-453c-8814-9fff7969f25d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-8052e8a9-038e-453c-8814-9fff7969f25d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Flow 'volume_create_manager' (c75fd4cf-fa21-4800-a531-57d50aeee7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-8052e8a9-038e-453c-8814-9fff7969f25d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb85c44a-7c2a-4ce5-a5a2-7bc2bc663767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-8052e8a9-038e-453c-8814-9fff7969f25d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb85c44a-7c2a-4ce5-a5a2-7bc2bc663767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1322585462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=673b90e1-6c28-47db-967f-b43cb06cfd7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06766b64e76446a9ab73bb4cc2c8a253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:49:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:49:30Z,use_quota=True,user_id='b98304b8951147e89fedc088b049a089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-8052e8a9-038e-453c-8814-9fff7969f25d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c0fefec-cfa2-41e0-bc3f-b74e120cb006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-8052e8a9-038e-453c-8814-9fff7969f25d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c0fefec-cfa2-41e0-bc3f-b74e120cb006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-8052e8a9-038e-453c-8814-9fff7969f25d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70be593b-0420-4462-9545-9a5210c7d4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-8052e8a9-038e-453c-8814-9fff7969f25d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70be593b-0420-4462-9545-9a5210c7d4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '673b90e1-6c28-47db-967f-b43cb06cfd7b', 'volume_name': 'volume-673b90e1-6c28-47db-967f-b43cb06cfd7b', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-8052e8a9-038e-453c-8814-9fff7969f25d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94f77889-274a-434f-8e10-03260fa52117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-8052e8a9-038e-453c-8814-9fff7969f25d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94f77889-274a-434f-8e10-03260fa52117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-8052e8a9-038e-453c-8814-9fff7969f25d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83f0dd57-2aaa-4f36-878b-5b4f118aa97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:29 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-8052e8a9-038e-453c-8814-9fff7969f25d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Volume 673b90e1-6c28-47db-967f-b43cb06cfd7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-673b90e1-6c28-47db-967f-b43cb06cfd7b', 'volume_size': 1}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-8052e8a9-038e-453c-8814-9fff7969f25d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:49:29 devstack sudo[91065]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6f8f8842-b7d1-4801-b55f-be01ca16c74d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bb68cbb0-4e52-4908-b0d6-9220b61c0f2d 1073741824" returned: 0 in 0.567s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6f8f8842-b7d1-4801-b55f-be01ca16c74d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bb68cbb0-4e52-4908-b0d6-9220b61c0f2d {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:29 devstack sudo[91071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bb68cbb0-4e52-4908-b0d6-9220b61c0f2d
Feb 28 04:49:29 devstack sudo[91071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf72a821-56c9-4022-b681-9c970ddb412c tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-bf72a821-56c9-4022-b681-9c970ddb412c tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Flow 'volume_create_manager' (0bd3db67-9dd4-4a0f-8977-dc0943294833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:49:29 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-bf72a821-56c9-4022-b681-9c970ddb412c tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f31750ff-7231-4886-a0dc-022eecec0ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:30 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-bf72a821-56c9-4022-b681-9c970ddb412c tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f31750ff-7231-4886-a0dc-022eecec0ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-807839517',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be65c560-d08f-4586-8530-84aff889ec2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06766b64e76446a9ab73bb4cc2c8a253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:49:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:49:30Z,use_quota=True,user_id='b98304b8951147e89fedc088b049a089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:30 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-bf72a821-56c9-4022-b681-9c970ddb412c tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c04a902a-8834-4377-96bb-f85bd51335de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:30 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-bf72a821-56c9-4022-b681-9c970ddb412c tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c04a902a-8834-4377-96bb-f85bd51335de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:30 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-bf72a821-56c9-4022-b681-9c970ddb412c tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4a2f0ed-3b38-4866-b6b6-6b35a4869e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:30 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-bf72a821-56c9-4022-b681-9c970ddb412c tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4a2f0ed-3b38-4866-b6b6-6b35a4869e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be65c560-d08f-4586-8530-84aff889ec2a', 'volume_name': 'volume-be65c560-d08f-4586-8530-84aff889ec2a', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:30 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-bf72a821-56c9-4022-b681-9c970ddb412c tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9725fa80-35c2-4e38-b07e-08b599e3de57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:30 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-bf72a821-56c9-4022-b681-9c970ddb412c tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9725fa80-35c2-4e38-b07e-08b599e3de57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:30 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-bf72a821-56c9-4022-b681-9c970ddb412c tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d46c529-da50-4a45-a28d-4fbe5b6fcac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:30 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-bf72a821-56c9-4022-b681-9c970ddb412c tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Volume be65c560-d08f-4586-8530-84aff889ec2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be65c560-d08f-4586-8530-84aff889ec2a', 'volume_size': 1}
Feb 28 04:49:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-bf72a821-56c9-4022-b681-9c970ddb412c tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:49:30 devstack sudo[91071]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6f8f8842-b7d1-4801-b55f-be01ca16c74d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bb68cbb0-4e52-4908-b0d6-9220b61c0f2d" returned: 0 in 0.419s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:30 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-6f8f8842-b7d1-4801-b55f-be01ca16c74d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:49:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-6f8f8842-b7d1-4801-b55f-be01ca16c74d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:49:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-6201bfdd-6ebf-4870-9187-6a398e99f30a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.810s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:49:30 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-6201bfdd-6ebf-4870-9187-6a398e99f30a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:49:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-781888360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28b99583-cb7c-4e3a-954b-60d71d7804e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06766b64e76446a9ab73bb4cc2c8a253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:49:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:49:29Z,use_quota=True,user_id='b98304b8951147e89fedc088b049a089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:49:30 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-6201bfdd-6ebf-4870-9187-6a398e99f30a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Creating volume 28b99583-cb7c-4e3a-954b-60d71d7804e6 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:49:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-6201bfdd-6ebf-4870-9187-6a398e99f30a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:49:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-6201bfdd-6ebf-4870-9187-6a398e99f30a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:49:30 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-6201bfdd-6ebf-4870-9187-6a398e99f30a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:49:30 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-6201bfdd-6ebf-4870-9187-6a398e99f30a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:49:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-6201bfdd-6ebf-4870-9187-6a398e99f30a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:49:30 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-6201bfdd-6ebf-4870-9187-6a398e99f30a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:49:30 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-6201bfdd-6ebf-4870-9187-6a398e99f30a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:49:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6201bfdd-6ebf-4870-9187-6a398e99f30a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-28b99583-cb7c-4e3a-954b-60d71d7804e6 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:30 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6f8f8842-b7d1-4801-b55f-be01ca16c74d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d395dccd-4b20-4571-8b15-e140e238e169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb68cbb0-4e52-4908-b0d6-9220b61c0f2d', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:30 devstack sudo[91074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-28b99583-cb7c-4e3a-954b-60d71d7804e6 1073741824
Feb 28 04:49:30 devstack sudo[91074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:30 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6f8f8842-b7d1-4801-b55f-be01ca16c74d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (214a5e0a-546b-4f2b-b0be-5dba777e45c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:30 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-6f8f8842-b7d1-4801-b55f-be01ca16c74d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Volume volume-bb68cbb0-4e52-4908-b0d6-9220b61c0f2d (bb68cbb0-4e52-4908-b0d6-9220b61c0f2d): created successfully
Feb 28 04:49:30 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6f8f8842-b7d1-4801-b55f-be01ca16c74d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (214a5e0a-546b-4f2b-b0be-5dba777e45c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:30 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6f8f8842-b7d1-4801-b55f-be01ca16c74d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Flow 'volume_create_manager' (625a5e06-e618-452a-8606-acf63dc46ddc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:49:30 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-6f8f8842-b7d1-4801-b55f-be01ca16c74d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Created volume successfully.
Feb 28 04:49:30 devstack sudo[91074]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6201bfdd-6ebf-4870-9187-6a398e99f30a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-28b99583-cb7c-4e3a-954b-60d71d7804e6 1073741824" returned: 0 in 0.476s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6201bfdd-6ebf-4870-9187-6a398e99f30a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-28b99583-cb7c-4e3a-954b-60d71d7804e6 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:30 devstack sudo[91079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-28b99583-cb7c-4e3a-954b-60d71d7804e6
Feb 28 04:49:30 devstack sudo[91079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:31 devstack sudo[91079]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6201bfdd-6ebf-4870-9187-6a398e99f30a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-28b99583-cb7c-4e3a-954b-60d71d7804e6" returned: 0 in 0.411s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:31 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-6201bfdd-6ebf-4870-9187-6a398e99f30a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:49:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-6201bfdd-6ebf-4870-9187-6a398e99f30a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:49:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b007543c-0c2c-4b3d-9e07-7cea69d4ead5 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.468s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:49:31 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-b007543c-0c2c-4b3d-9e07-7cea69d4ead5 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:49:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1515104844',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f872cc8-80b9-4530-b411-577325991c2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06766b64e76446a9ab73bb4cc2c8a253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:49:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:49:30Z,use_quota=True,user_id='b98304b8951147e89fedc088b049a089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:49:31 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-b007543c-0c2c-4b3d-9e07-7cea69d4ead5 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Creating volume 6f872cc8-80b9-4530-b411-577325991c2e {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:49:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b007543c-0c2c-4b3d-9e07-7cea69d4ead5 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:49:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b007543c-0c2c-4b3d-9e07-7cea69d4ead5 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:49:31 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-b007543c-0c2c-4b3d-9e07-7cea69d4ead5 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:49:31 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-b007543c-0c2c-4b3d-9e07-7cea69d4ead5 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:49:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b007543c-0c2c-4b3d-9e07-7cea69d4ead5 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:49:31 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-b007543c-0c2c-4b3d-9e07-7cea69d4ead5 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:49:31 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-b007543c-0c2c-4b3d-9e07-7cea69d4ead5 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:49:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b007543c-0c2c-4b3d-9e07-7cea69d4ead5 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f872cc8-80b9-4530-b411-577325991c2e 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:31 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6201bfdd-6ebf-4870-9187-6a398e99f30a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (536944b5-702b-4974-9fd5-b9e0e077a825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28b99583-cb7c-4e3a-954b-60d71d7804e6', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:31 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6201bfdd-6ebf-4870-9187-6a398e99f30a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fb07098-83c0-4b5b-a0f0-fcd15b51a9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:31 devstack sudo[91082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f872cc8-80b9-4530-b411-577325991c2e 1073741824
Feb 28 04:49:31 devstack sudo[91082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:31 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-6201bfdd-6ebf-4870-9187-6a398e99f30a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Volume volume-28b99583-cb7c-4e3a-954b-60d71d7804e6 (28b99583-cb7c-4e3a-954b-60d71d7804e6): created successfully
Feb 28 04:49:31 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6201bfdd-6ebf-4870-9187-6a398e99f30a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fb07098-83c0-4b5b-a0f0-fcd15b51a9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:31 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6201bfdd-6ebf-4870-9187-6a398e99f30a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Flow 'volume_create_manager' (0536b01c-a355-4b5f-ac82-894065e2fa80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:49:31 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-6201bfdd-6ebf-4870-9187-6a398e99f30a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Created volume successfully.
Feb 28 04:49:31 devstack sudo[91082]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b007543c-0c2c-4b3d-9e07-7cea69d4ead5 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f872cc8-80b9-4530-b411-577325991c2e 1073741824" returned: 0 in 0.473s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b007543c-0c2c-4b3d-9e07-7cea69d4ead5 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f872cc8-80b9-4530-b411-577325991c2e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:31 devstack sudo[91087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f872cc8-80b9-4530-b411-577325991c2e
Feb 28 04:49:31 devstack sudo[91087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:32 devstack sudo[91087]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b007543c-0c2c-4b3d-9e07-7cea69d4ead5 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f872cc8-80b9-4530-b411-577325991c2e" returned: 0 in 0.415s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:32 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-b007543c-0c2c-4b3d-9e07-7cea69d4ead5 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:49:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b007543c-0c2c-4b3d-9e07-7cea69d4ead5 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:49:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-8052e8a9-038e-453c-8814-9fff7969f25d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.292s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:49:32 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-8052e8a9-038e-453c-8814-9fff7969f25d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1322585462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=673b90e1-6c28-47db-967f-b43cb06cfd7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06766b64e76446a9ab73bb4cc2c8a253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:49:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:49:30Z,use_quota=True,user_id='b98304b8951147e89fedc088b049a089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:49:32 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-8052e8a9-038e-453c-8814-9fff7969f25d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Creating volume 673b90e1-6c28-47db-967f-b43cb06cfd7b {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:49:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-8052e8a9-038e-453c-8814-9fff7969f25d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:49:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-8052e8a9-038e-453c-8814-9fff7969f25d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:49:32 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-8052e8a9-038e-453c-8814-9fff7969f25d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:49:32 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-8052e8a9-038e-453c-8814-9fff7969f25d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:49:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-8052e8a9-038e-453c-8814-9fff7969f25d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:49:32 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-8052e8a9-038e-453c-8814-9fff7969f25d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:49:32 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-8052e8a9-038e-453c-8814-9fff7969f25d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:49:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8052e8a9-038e-453c-8814-9fff7969f25d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-673b90e1-6c28-47db-967f-b43cb06cfd7b 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:32 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b007543c-0c2c-4b3d-9e07-7cea69d4ead5 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5b06cad-473d-4752-96f8-be9b820eda10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f872cc8-80b9-4530-b411-577325991c2e', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:32 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b007543c-0c2c-4b3d-9e07-7cea69d4ead5 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf933ca1-fe0c-4b56-ade3-a0747cc7977b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:32 devstack sudo[91090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-673b90e1-6c28-47db-967f-b43cb06cfd7b 1073741824
Feb 28 04:49:32 devstack sudo[91090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:32 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-b007543c-0c2c-4b3d-9e07-7cea69d4ead5 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Volume volume-6f872cc8-80b9-4530-b411-577325991c2e (6f872cc8-80b9-4530-b411-577325991c2e): created successfully
Feb 28 04:49:32 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b007543c-0c2c-4b3d-9e07-7cea69d4ead5 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf933ca1-fe0c-4b56-ade3-a0747cc7977b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:32 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b007543c-0c2c-4b3d-9e07-7cea69d4ead5 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Flow 'volume_create_manager' (6d36d1d6-ef9f-44a5-a568-f3eee9e8dcf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:49:32 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-b007543c-0c2c-4b3d-9e07-7cea69d4ead5 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Created volume successfully.
Feb 28 04:49:32 devstack sudo[91090]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8052e8a9-038e-453c-8814-9fff7969f25d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-673b90e1-6c28-47db-967f-b43cb06cfd7b 1073741824" returned: 0 in 0.462s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8052e8a9-038e-453c-8814-9fff7969f25d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-673b90e1-6c28-47db-967f-b43cb06cfd7b {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:32 devstack sudo[91095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-673b90e1-6c28-47db-967f-b43cb06cfd7b
Feb 28 04:49:32 devstack sudo[91095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:32 devstack sudo[91095]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8052e8a9-038e-453c-8814-9fff7969f25d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-673b90e1-6c28-47db-967f-b43cb06cfd7b" returned: 0 in 0.397s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:32 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-8052e8a9-038e-453c-8814-9fff7969f25d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:49:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-8052e8a9-038e-453c-8814-9fff7969f25d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:49:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-bf72a821-56c9-4022-b681-9c970ddb412c tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.956s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:49:32 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-bf72a821-56c9-4022-b681-9c970ddb412c tempest-CreateVolumesFromSourceVolumeTest-129109169 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-807839517',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be65c560-d08f-4586-8530-84aff889ec2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06766b64e76446a9ab73bb4cc2c8a253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:49:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:49:30Z,use_quota=True,user_id='b98304b8951147e89fedc088b049a089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:49:32 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-bf72a821-56c9-4022-b681-9c970ddb412c tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Creating volume be65c560-d08f-4586-8530-84aff889ec2a {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:49:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-bf72a821-56c9-4022-b681-9c970ddb412c tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:49:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-bf72a821-56c9-4022-b681-9c970ddb412c tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:49:32 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-bf72a821-56c9-4022-b681-9c970ddb412c tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:49:32 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-bf72a821-56c9-4022-b681-9c970ddb412c tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:49:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-bf72a821-56c9-4022-b681-9c970ddb412c tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:49:32 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-bf72a821-56c9-4022-b681-9c970ddb412c tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:49:32 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-bf72a821-56c9-4022-b681-9c970ddb412c tempest-CreateVolumesFromSourceVolumeTest-129109169 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:49:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-bf72a821-56c9-4022-b681-9c970ddb412c tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-be65c560-d08f-4586-8530-84aff889ec2a 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:33 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-8052e8a9-038e-453c-8814-9fff7969f25d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83f0dd57-2aaa-4f36-878b-5b4f118aa97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-673b90e1-6c28-47db-967f-b43cb06cfd7b', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:33 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-8052e8a9-038e-453c-8814-9fff7969f25d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bae1f195-d87f-4d8e-a2a5-3bee4f28593e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:33 devstack sudo[91098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-be65c560-d08f-4586-8530-84aff889ec2a 1073741824
Feb 28 04:49:33 devstack sudo[91098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:33 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-8052e8a9-038e-453c-8814-9fff7969f25d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Volume volume-673b90e1-6c28-47db-967f-b43cb06cfd7b (673b90e1-6c28-47db-967f-b43cb06cfd7b): created successfully
Feb 28 04:49:33 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-8052e8a9-038e-453c-8814-9fff7969f25d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bae1f195-d87f-4d8e-a2a5-3bee4f28593e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:33 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-8052e8a9-038e-453c-8814-9fff7969f25d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Flow 'volume_create_manager' (c75fd4cf-fa21-4800-a531-57d50aeee7b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:49:33 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-8052e8a9-038e-453c-8814-9fff7969f25d tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Created volume successfully.
Feb 28 04:49:33 devstack sudo[91098]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-bf72a821-56c9-4022-b681-9c970ddb412c tempest-CreateVolumesFromSourceVolumeTest-129109169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-be65c560-d08f-4586-8530-84aff889ec2a 1073741824" returned: 0 in 0.479s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-bf72a821-56c9-4022-b681-9c970ddb412c tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-be65c560-d08f-4586-8530-84aff889ec2a {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:33 devstack sudo[91103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-be65c560-d08f-4586-8530-84aff889ec2a
Feb 28 04:49:33 devstack sudo[91103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:33 devstack sudo[91103]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-bf72a821-56c9-4022-b681-9c970ddb412c tempest-CreateVolumesFromSourceVolumeTest-129109169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-be65c560-d08f-4586-8530-84aff889ec2a" returned: 0 in 0.401s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:33 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-bf72a821-56c9-4022-b681-9c970ddb412c tempest-CreateVolumesFromSourceVolumeTest-129109169 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:49:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-bf72a821-56c9-4022-b681-9c970ddb412c tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:49:33 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-bf72a821-56c9-4022-b681-9c970ddb412c tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d46c529-da50-4a45-a28d-4fbe5b6fcac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be65c560-d08f-4586-8530-84aff889ec2a', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:33 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-bf72a821-56c9-4022-b681-9c970ddb412c tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef5d2b19-053a-4787-a0a5-cd870eb622c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:33 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-bf72a821-56c9-4022-b681-9c970ddb412c tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Volume volume-be65c560-d08f-4586-8530-84aff889ec2a (be65c560-d08f-4586-8530-84aff889ec2a): created successfully
Feb 28 04:49:33 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-bf72a821-56c9-4022-b681-9c970ddb412c tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef5d2b19-053a-4787-a0a5-cd870eb622c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:33 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-bf72a821-56c9-4022-b681-9c970ddb412c tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Flow 'volume_create_manager' (0bd3db67-9dd4-4a0f-8977-dc0943294833) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:49:33 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-bf72a821-56c9-4022-b681-9c970ddb412c tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Created volume successfully.
Feb 28 04:49:34 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-fe2f4f86-2522-4f9e-b082-eb0a61f769f0 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Acquiring lock "cinder-be65c560-d08f-4586-8530-84aff889ec2a-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:49:34 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-fe2f4f86-2522-4f9e-b082-eb0a61f769f0 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "cinder-be65c560-d08f-4586-8530-84aff889ec2a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:49:34 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-fe2f4f86-2522-4f9e-b082-eb0a61f769f0 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Acquiring lock "cinder-quobyte-be65c560-d08f-4586-8530-84aff889ec2a" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:49:34 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-fe2f4f86-2522-4f9e-b082-eb0a61f769f0 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "cinder-quobyte-be65c560-d08f-4586-8530-84aff889ec2a" acquired by "delete_volume" :: waited 0.014s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:49:34 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d7444b-0056-4fa2-bd1e-59b0381660c0]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:49:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-fe2f4f86-2522-4f9e-b082-eb0a61f769f0 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-be65c560-d08f-4586-8530-84aff889ec2a {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:34 devstack sudo[91106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-be65c560-d08f-4586-8530-84aff889ec2a
Feb 28 04:49:34 devstack sudo[91106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:34 devstack sudo[91106]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-fe2f4f86-2522-4f9e-b082-eb0a61f769f0 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-be65c560-d08f-4586-8530-84aff889ec2a" returned: 0 in 0.465s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-fe2f4f86-2522-4f9e-b082-eb0a61f769f0 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-be65c560-d08f-4586-8530-84aff889ec2a {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:34 devstack sudo[91111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-be65c560-d08f-4586-8530-84aff889ec2a
Feb 28 04:49:34 devstack sudo[91111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:35 devstack sudo[91111]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-fe2f4f86-2522-4f9e-b082-eb0a61f769f0 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-be65c560-d08f-4586-8530-84aff889ec2a" returned: 0 in 0.421s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:35 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-fe2f4f86-2522-4f9e-b082-eb0a61f769f0 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "cinder-quobyte-be65c560-d08f-4586-8530-84aff889ec2a" released by "delete_volume" :: held 0.908s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:49:35 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-fe2f4f86-2522-4f9e-b082-eb0a61f769f0 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Created reservations ['65ba982f-a4bd-47e3-bbc1-d1976ebedc9f', 'e1118f07-7a2c-4775-9316-df9216c4a06b', '2868cb17-8d2b-4e4b-88ab-ec1e4841cfa9', '93155afd-a588-4fcd-be4f-fbffebbed632'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:49:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-fe2f4f86-2522-4f9e-b082-eb0a61f769f0 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:49:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-fe2f4f86-2522-4f9e-b082-eb0a61f769f0 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:49:35 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-fe2f4f86-2522-4f9e-b082-eb0a61f769f0 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:49:35 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-fe2f4f86-2522-4f9e-b082-eb0a61f769f0 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:49:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-fe2f4f86-2522-4f9e-b082-eb0a61f769f0 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:49:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-fe2f4f86-2522-4f9e-b082-eb0a61f769f0 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:35 devstack sudo[91114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:49:35 devstack sudo[91114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:35 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1d4ef909-ae8f-4746-8f9e-733420c294d3 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Acquiring lock "cinder-673b90e1-6c28-47db-967f-b43cb06cfd7b-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:49:35 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1d4ef909-ae8f-4746-8f9e-733420c294d3 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "cinder-673b90e1-6c28-47db-967f-b43cb06cfd7b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:49:35 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1d4ef909-ae8f-4746-8f9e-733420c294d3 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Acquiring lock "cinder-quobyte-673b90e1-6c28-47db-967f-b43cb06cfd7b" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:49:35 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1d4ef909-ae8f-4746-8f9e-733420c294d3 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "cinder-quobyte-673b90e1-6c28-47db-967f-b43cb06cfd7b" acquired by "delete_volume" :: waited 0.010s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:49:35 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ac062b-92a5-4c5c-8680-133509cb2078]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:49:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1d4ef909-ae8f-4746-8f9e-733420c294d3 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-673b90e1-6c28-47db-967f-b43cb06cfd7b {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:35 devstack sudo[91116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-673b90e1-6c28-47db-967f-b43cb06cfd7b
Feb 28 04:49:35 devstack sudo[91116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:35 devstack sudo[91114]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-fe2f4f86-2522-4f9e-b082-eb0a61f769f0 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.441s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:35 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-fe2f4f86-2522-4f9e-b082-eb0a61f769f0 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:49:35 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-fe2f4f86-2522-4f9e-b082-eb0a61f769f0 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Deleted volume successfully.
Feb 28 04:49:35 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-fe2f4f86-2522-4f9e-b082-eb0a61f769f0 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "cinder-be65c560-d08f-4586-8530-84aff889ec2a-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:49:36 devstack sudo[91116]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1d4ef909-ae8f-4746-8f9e-733420c294d3 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-673b90e1-6c28-47db-967f-b43cb06cfd7b" returned: 0 in 0.487s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1d4ef909-ae8f-4746-8f9e-733420c294d3 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-673b90e1-6c28-47db-967f-b43cb06cfd7b {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:36 devstack sudo[91122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-673b90e1-6c28-47db-967f-b43cb06cfd7b
Feb 28 04:49:36 devstack sudo[91122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:36 devstack sudo[91122]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1d4ef909-ae8f-4746-8f9e-733420c294d3 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-673b90e1-6c28-47db-967f-b43cb06cfd7b" returned: 0 in 0.390s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:36 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1d4ef909-ae8f-4746-8f9e-733420c294d3 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "cinder-quobyte-673b90e1-6c28-47db-967f-b43cb06cfd7b" released by "delete_volume" :: held 0.901s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:49:36 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-1d4ef909-ae8f-4746-8f9e-733420c294d3 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Created reservations ['930f8a4d-9e74-4384-b777-efe0e505e38e', 'ed1af2a2-7644-4234-afdc-8b5f1d59b2cf', '65ff3576-b89a-4f17-a651-331f0776ddc0', 'eadd0173-11d3-4eed-b767-7cbe7996feae'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:49:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-1d4ef909-ae8f-4746-8f9e-733420c294d3 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:49:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-1d4ef909-ae8f-4746-8f9e-733420c294d3 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:49:36 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-1d4ef909-ae8f-4746-8f9e-733420c294d3 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:49:36 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-1d4ef909-ae8f-4746-8f9e-733420c294d3 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:49:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-1d4ef909-ae8f-4746-8f9e-733420c294d3 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:49:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1d4ef909-ae8f-4746-8f9e-733420c294d3 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:36 devstack sudo[91125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:49:36 devstack sudo[91125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:36 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-0465d1f2-fc59-4ac5-8d19-758a963c450a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Acquiring lock "cinder-6f872cc8-80b9-4530-b411-577325991c2e-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:49:36 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-0465d1f2-fc59-4ac5-8d19-758a963c450a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "cinder-6f872cc8-80b9-4530-b411-577325991c2e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:49:36 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-0465d1f2-fc59-4ac5-8d19-758a963c450a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Acquiring lock "cinder-quobyte-6f872cc8-80b9-4530-b411-577325991c2e" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:49:36 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-0465d1f2-fc59-4ac5-8d19-758a963c450a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "cinder-quobyte-6f872cc8-80b9-4530-b411-577325991c2e" acquired by "delete_volume" :: waited 0.010s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:49:36 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[84bd2d53-fc3b-47f4-af3e-063ea4ac18f8]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:49:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-0465d1f2-fc59-4ac5-8d19-758a963c450a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f872cc8-80b9-4530-b411-577325991c2e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:36 devstack sudo[91127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f872cc8-80b9-4530-b411-577325991c2e
Feb 28 04:49:36 devstack sudo[91127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:36 devstack sudo[91125]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-1d4ef909-ae8f-4746-8f9e-733420c294d3 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.415s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:36 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-1d4ef909-ae8f-4746-8f9e-733420c294d3 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:49:36 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-1d4ef909-ae8f-4746-8f9e-733420c294d3 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Deleted volume successfully.
Feb 28 04:49:36 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-1d4ef909-ae8f-4746-8f9e-733420c294d3 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "cinder-673b90e1-6c28-47db-967f-b43cb06cfd7b-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:49:37 devstack sudo[91127]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-0465d1f2-fc59-4ac5-8d19-758a963c450a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f872cc8-80b9-4530-b411-577325991c2e" returned: 0 in 0.486s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-0465d1f2-fc59-4ac5-8d19-758a963c450a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f872cc8-80b9-4530-b411-577325991c2e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:37 devstack sudo[91133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f872cc8-80b9-4530-b411-577325991c2e
Feb 28 04:49:37 devstack sudo[91133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:37 devstack sudo[91133]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-0465d1f2-fc59-4ac5-8d19-758a963c450a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6f872cc8-80b9-4530-b411-577325991c2e" returned: 0 in 0.401s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:37 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-0465d1f2-fc59-4ac5-8d19-758a963c450a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "cinder-quobyte-6f872cc8-80b9-4530-b411-577325991c2e" released by "delete_volume" :: held 0.910s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:49:37 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-0465d1f2-fc59-4ac5-8d19-758a963c450a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Created reservations ['9a7c8f0b-465b-44ea-bcdf-0955379f3dd7', '1cba7718-fc9b-4c8f-8a98-e844da087de3', '2f36a42e-6b04-49d7-8429-54597e2ff8df', '868dc318-2180-4ac1-afcb-980141840cfa'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:49:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-0465d1f2-fc59-4ac5-8d19-758a963c450a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:49:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-0465d1f2-fc59-4ac5-8d19-758a963c450a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:49:37 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-0465d1f2-fc59-4ac5-8d19-758a963c450a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:49:37 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-0465d1f2-fc59-4ac5-8d19-758a963c450a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:49:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-0465d1f2-fc59-4ac5-8d19-758a963c450a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:49:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-0465d1f2-fc59-4ac5-8d19-758a963c450a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:37 devstack sudo[91136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:49:37 devstack sudo[91136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:37 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-5070f33f-bc71-48d1-9a5d-e44c77669896 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Acquiring lock "cinder-28b99583-cb7c-4e3a-954b-60d71d7804e6-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:49:37 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-5070f33f-bc71-48d1-9a5d-e44c77669896 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "cinder-28b99583-cb7c-4e3a-954b-60d71d7804e6-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:49:37 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-5070f33f-bc71-48d1-9a5d-e44c77669896 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Acquiring lock "cinder-quobyte-28b99583-cb7c-4e3a-954b-60d71d7804e6" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:49:37 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-5070f33f-bc71-48d1-9a5d-e44c77669896 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "cinder-quobyte-28b99583-cb7c-4e3a-954b-60d71d7804e6" acquired by "delete_volume" :: waited 0.009s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:49:37 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf15a52-ee6f-4516-bc4a-af8b83b2fc73]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:49:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5070f33f-bc71-48d1-9a5d-e44c77669896 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-28b99583-cb7c-4e3a-954b-60d71d7804e6 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:37 devstack sudo[91138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-28b99583-cb7c-4e3a-954b-60d71d7804e6
Feb 28 04:49:37 devstack sudo[91138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:38 devstack sudo[91136]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-0465d1f2-fc59-4ac5-8d19-758a963c450a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.419s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:38 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-0465d1f2-fc59-4ac5-8d19-758a963c450a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:49:38 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-0465d1f2-fc59-4ac5-8d19-758a963c450a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Deleted volume successfully.
Feb 28 04:49:38 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-0465d1f2-fc59-4ac5-8d19-758a963c450a tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "cinder-6f872cc8-80b9-4530-b411-577325991c2e-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:49:38 devstack sudo[91138]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5070f33f-bc71-48d1-9a5d-e44c77669896 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-28b99583-cb7c-4e3a-954b-60d71d7804e6" returned: 0 in 0.473s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5070f33f-bc71-48d1-9a5d-e44c77669896 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-28b99583-cb7c-4e3a-954b-60d71d7804e6 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:38 devstack sudo[91144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-28b99583-cb7c-4e3a-954b-60d71d7804e6
Feb 28 04:49:38 devstack sudo[91144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:38 devstack sudo[91144]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5070f33f-bc71-48d1-9a5d-e44c77669896 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-28b99583-cb7c-4e3a-954b-60d71d7804e6" returned: 0 in 0.400s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:38 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-5070f33f-bc71-48d1-9a5d-e44c77669896 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "cinder-quobyte-28b99583-cb7c-4e3a-954b-60d71d7804e6" released by "delete_volume" :: held 0.895s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:49:38 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-5070f33f-bc71-48d1-9a5d-e44c77669896 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Created reservations ['788bb416-44e9-4787-87d9-3648baa3e2f2', '11ffa4c3-9196-4af7-8683-4e4bc683907f', 'eedf3e19-0ba2-4ace-aa8d-742227cd9a1a', '4b54154b-7d51-4257-8cc8-f7b43471c07f'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:49:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5070f33f-bc71-48d1-9a5d-e44c77669896 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:49:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5070f33f-bc71-48d1-9a5d-e44c77669896 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:49:38 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-5070f33f-bc71-48d1-9a5d-e44c77669896 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:49:38 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-5070f33f-bc71-48d1-9a5d-e44c77669896 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:49:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5070f33f-bc71-48d1-9a5d-e44c77669896 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:49:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5070f33f-bc71-48d1-9a5d-e44c77669896 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:38 devstack sudo[91147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:49:38 devstack sudo[91147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:38 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-02e0d48a-c9c5-4d09-be50-b38392df84b8 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Acquiring lock "cinder-bb68cbb0-4e52-4908-b0d6-9220b61c0f2d-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:49:38 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-02e0d48a-c9c5-4d09-be50-b38392df84b8 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "cinder-bb68cbb0-4e52-4908-b0d6-9220b61c0f2d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:49:38 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-02e0d48a-c9c5-4d09-be50-b38392df84b8 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Acquiring lock "cinder-quobyte-bb68cbb0-4e52-4908-b0d6-9220b61c0f2d" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:49:38 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-02e0d48a-c9c5-4d09-be50-b38392df84b8 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "cinder-quobyte-bb68cbb0-4e52-4908-b0d6-9220b61c0f2d" acquired by "delete_volume" :: waited 0.009s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:49:38 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00d26b4-1a00-44ff-97d5-21ee30374e2a]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:49:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-02e0d48a-c9c5-4d09-be50-b38392df84b8 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bb68cbb0-4e52-4908-b0d6-9220b61c0f2d {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:38 devstack sudo[91149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bb68cbb0-4e52-4908-b0d6-9220b61c0f2d
Feb 28 04:49:38 devstack sudo[91149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:39 devstack sudo[91147]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5070f33f-bc71-48d1-9a5d-e44c77669896 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.424s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:39 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-5070f33f-bc71-48d1-9a5d-e44c77669896 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:49:39 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-5070f33f-bc71-48d1-9a5d-e44c77669896 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Deleted volume successfully.
Feb 28 04:49:39 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-5070f33f-bc71-48d1-9a5d-e44c77669896 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "cinder-28b99583-cb7c-4e3a-954b-60d71d7804e6-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:49:39 devstack sudo[91149]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-02e0d48a-c9c5-4d09-be50-b38392df84b8 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bb68cbb0-4e52-4908-b0d6-9220b61c0f2d" returned: 0 in 0.482s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-02e0d48a-c9c5-4d09-be50-b38392df84b8 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bb68cbb0-4e52-4908-b0d6-9220b61c0f2d {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:39 devstack sudo[91155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bb68cbb0-4e52-4908-b0d6-9220b61c0f2d
Feb 28 04:49:39 devstack sudo[91155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:39 devstack sudo[91155]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-02e0d48a-c9c5-4d09-be50-b38392df84b8 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-bb68cbb0-4e52-4908-b0d6-9220b61c0f2d" returned: 0 in 0.394s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:39 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-02e0d48a-c9c5-4d09-be50-b38392df84b8 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "cinder-quobyte-bb68cbb0-4e52-4908-b0d6-9220b61c0f2d" released by "delete_volume" :: held 0.898s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:49:39 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-02e0d48a-c9c5-4d09-be50-b38392df84b8 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Created reservations ['07fd9020-d06f-40b8-807b-7dd604c32fd4', '11bb7e50-d831-4a6c-a456-c0ea9869be69', 'c3132dd3-3de7-4a3f-8692-4c93a4ee53b6', 'a25a4115-64db-4216-a027-e50e55f3fbff'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:49:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-02e0d48a-c9c5-4d09-be50-b38392df84b8 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:49:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-02e0d48a-c9c5-4d09-be50-b38392df84b8 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:49:39 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-02e0d48a-c9c5-4d09-be50-b38392df84b8 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:49:39 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-02e0d48a-c9c5-4d09-be50-b38392df84b8 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:49:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-02e0d48a-c9c5-4d09-be50-b38392df84b8 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:49:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-02e0d48a-c9c5-4d09-be50-b38392df84b8 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:39 devstack sudo[91159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:49:39 devstack sudo[91159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:39 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-a7c9f3d7-a705-46a5-adc2-1474a5942d98 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Acquiring lock "cinder-b0563fb4-ff22-4345-9410-9f6c59135a67-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:49:39 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-a7c9f3d7-a705-46a5-adc2-1474a5942d98 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "cinder-b0563fb4-ff22-4345-9410-9f6c59135a67-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:49:40 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-a7c9f3d7-a705-46a5-adc2-1474a5942d98 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Acquiring lock "cinder-quobyte-b0563fb4-ff22-4345-9410-9f6c59135a67" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:49:40 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-a7c9f3d7-a705-46a5-adc2-1474a5942d98 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "cinder-quobyte-b0563fb4-ff22-4345-9410-9f6c59135a67" acquired by "delete_volume" :: waited 0.008s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:49:40 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf9160e-c218-4d5b-90ea-b80315a0bc25]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:49:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a7c9f3d7-a705-46a5-adc2-1474a5942d98 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b0563fb4-ff22-4345-9410-9f6c59135a67 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:40 devstack sudo[91161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b0563fb4-ff22-4345-9410-9f6c59135a67
Feb 28 04:49:40 devstack sudo[91161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:40 devstack sudo[91159]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-02e0d48a-c9c5-4d09-be50-b38392df84b8 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.424s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:40 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-02e0d48a-c9c5-4d09-be50-b38392df84b8 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:49:40 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-02e0d48a-c9c5-4d09-be50-b38392df84b8 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Deleted volume successfully.
Feb 28 04:49:40 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-02e0d48a-c9c5-4d09-be50-b38392df84b8 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "cinder-bb68cbb0-4e52-4908-b0d6-9220b61c0f2d-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:49:40 devstack sudo[91161]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a7c9f3d7-a705-46a5-adc2-1474a5942d98 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b0563fb4-ff22-4345-9410-9f6c59135a67" returned: 0 in 0.487s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a7c9f3d7-a705-46a5-adc2-1474a5942d98 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b0563fb4-ff22-4345-9410-9f6c59135a67 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:40 devstack sudo[91167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b0563fb4-ff22-4345-9410-9f6c59135a67
Feb 28 04:49:40 devstack sudo[91167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:40 devstack sudo[91167]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a7c9f3d7-a705-46a5-adc2-1474a5942d98 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b0563fb4-ff22-4345-9410-9f6c59135a67" returned: 0 in 0.406s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:40 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-a7c9f3d7-a705-46a5-adc2-1474a5942d98 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "cinder-quobyte-b0563fb4-ff22-4345-9410-9f6c59135a67" released by "delete_volume" :: held 0.916s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:49:40 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-a7c9f3d7-a705-46a5-adc2-1474a5942d98 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Created reservations ['28fcbe6b-1aa9-4820-9881-8d4ac9b08a26', 'ed16e69e-c5c9-49ea-9970-5e2eba459abf', '6d2b64b3-5992-48bd-b622-174499247b74', '7087806f-325e-4d02-82ac-3e03c789d8e3'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:49:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a7c9f3d7-a705-46a5-adc2-1474a5942d98 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:49:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a7c9f3d7-a705-46a5-adc2-1474a5942d98 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:49:40 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-a7c9f3d7-a705-46a5-adc2-1474a5942d98 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:49:40 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-a7c9f3d7-a705-46a5-adc2-1474a5942d98 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:49:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a7c9f3d7-a705-46a5-adc2-1474a5942d98 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:49:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a7c9f3d7-a705-46a5-adc2-1474a5942d98 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:41 devstack sudo[91170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:49:41 devstack sudo[91170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:41 devstack sudo[91170]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a7c9f3d7-a705-46a5-adc2-1474a5942d98 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.462s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:41 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-a7c9f3d7-a705-46a5-adc2-1474a5942d98 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:49:41 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-a7c9f3d7-a705-46a5-adc2-1474a5942d98 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Deleted volume successfully.
Feb 28 04:49:41 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-a7c9f3d7-a705-46a5-adc2-1474a5942d98 tempest-CreateVolumesFromSourceVolumeTest-129109169 None] Lock "cinder-b0563fb4-ff22-4345-9410-9f6c59135a67-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:49:42 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-32f33439-6ef4-4505-9cca-edcf17bc4d6f tempest-CinderUnicodeTest-350644894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:49:42 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-32f33439-6ef4-4505-9cca-edcf17bc4d6f tempest-CinderUnicodeTest-350644894 None] Flow 'volume_create_manager' (755bf7e5-8b9f-404f-b58f-5843c9259090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:49:42 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-32f33439-6ef4-4505-9cca-edcf17bc4d6f tempest-CinderUnicodeTest-350644894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (237f8628-88a4-4683-b19b-b4d9f321bab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:42 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-32f33439-6ef4-4505-9cca-edcf17bc4d6f tempest-CinderUnicodeTest-350644894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (237f8628-88a4-4683-b19b-b4d9f321bab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=730ccc89-a930-46be-948a-19f79336a88e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05aef9d2c87f408b9db1b6be7b84bf1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:49:43Z,use_quota=True,user_id='04e2a04f913848bc88cff8b0ae51a1e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:42 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-32f33439-6ef4-4505-9cca-edcf17bc4d6f tempest-CinderUnicodeTest-350644894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0da1754b-8945-47bb-a148-463779b9a4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:42 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-32f33439-6ef4-4505-9cca-edcf17bc4d6f tempest-CinderUnicodeTest-350644894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0da1754b-8945-47bb-a148-463779b9a4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:42 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-32f33439-6ef4-4505-9cca-edcf17bc4d6f tempest-CinderUnicodeTest-350644894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e2c581e-9d37-4b9b-a3a9-1824984b74b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:42 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-32f33439-6ef4-4505-9cca-edcf17bc4d6f tempest-CinderUnicodeTest-350644894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e2c581e-9d37-4b9b-a3a9-1824984b74b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '730ccc89-a930-46be-948a-19f79336a88e', 'volume_name': 'volume-730ccc89-a930-46be-948a-19f79336a88e', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:42 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-32f33439-6ef4-4505-9cca-edcf17bc4d6f tempest-CinderUnicodeTest-350644894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff956168-9063-4dca-bf02-e91f2ec4a336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:42 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-32f33439-6ef4-4505-9cca-edcf17bc4d6f tempest-CinderUnicodeTest-350644894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff956168-9063-4dca-bf02-e91f2ec4a336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:42 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-32f33439-6ef4-4505-9cca-edcf17bc4d6f tempest-CinderUnicodeTest-350644894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5996e9b-4f09-4fc5-b0a5-9067c25deb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:42 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-32f33439-6ef4-4505-9cca-edcf17bc4d6f tempest-CinderUnicodeTest-350644894 None] Volume 730ccc89-a930-46be-948a-19f79336a88e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-730ccc89-a930-46be-948a-19f79336a88e', 'volume_size': 1}
Feb 28 04:49:42 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-32f33439-6ef4-4505-9cca-edcf17bc4d6f tempest-CinderUnicodeTest-350644894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:49:42 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-32f33439-6ef4-4505-9cca-edcf17bc4d6f tempest-CinderUnicodeTest-350644894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:49:42 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-32f33439-6ef4-4505-9cca-edcf17bc4d6f tempest-CinderUnicodeTest-350644894 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=730ccc89-a930-46be-948a-19f79336a88e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05aef9d2c87f408b9db1b6be7b84bf1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:49:43Z,use_quota=True,user_id='04e2a04f913848bc88cff8b0ae51a1e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:49:42 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-32f33439-6ef4-4505-9cca-edcf17bc4d6f tempest-CinderUnicodeTest-350644894 None] Creating volume 730ccc89-a930-46be-948a-19f79336a88e {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:49:42 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-32f33439-6ef4-4505-9cca-edcf17bc4d6f tempest-CinderUnicodeTest-350644894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:49:42 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-32f33439-6ef4-4505-9cca-edcf17bc4d6f tempest-CinderUnicodeTest-350644894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:49:42 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-32f33439-6ef4-4505-9cca-edcf17bc4d6f tempest-CinderUnicodeTest-350644894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:49:42 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-32f33439-6ef4-4505-9cca-edcf17bc4d6f tempest-CinderUnicodeTest-350644894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:49:42 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-32f33439-6ef4-4505-9cca-edcf17bc4d6f tempest-CinderUnicodeTest-350644894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:49:42 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-32f33439-6ef4-4505-9cca-edcf17bc4d6f tempest-CinderUnicodeTest-350644894 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:49:42 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-32f33439-6ef4-4505-9cca-edcf17bc4d6f tempest-CinderUnicodeTest-350644894 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:49:42 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-32f33439-6ef4-4505-9cca-edcf17bc4d6f tempest-CinderUnicodeTest-350644894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-730ccc89-a930-46be-948a-19f79336a88e 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:42 devstack sudo[91173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-730ccc89-a930-46be-948a-19f79336a88e 1073741824
Feb 28 04:49:42 devstack sudo[91173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:43 devstack sudo[91173]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:43 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-32f33439-6ef4-4505-9cca-edcf17bc4d6f tempest-CinderUnicodeTest-350644894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-730ccc89-a930-46be-948a-19f79336a88e 1073741824" returned: 0 in 0.473s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:43 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-32f33439-6ef4-4505-9cca-edcf17bc4d6f tempest-CinderUnicodeTest-350644894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-730ccc89-a930-46be-948a-19f79336a88e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:43 devstack sudo[91178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-730ccc89-a930-46be-948a-19f79336a88e
Feb 28 04:49:43 devstack sudo[91178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:43 devstack sudo[91178]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:43 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-32f33439-6ef4-4505-9cca-edcf17bc4d6f tempest-CinderUnicodeTest-350644894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-730ccc89-a930-46be-948a-19f79336a88e" returned: 0 in 0.412s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:43 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-32f33439-6ef4-4505-9cca-edcf17bc4d6f tempest-CinderUnicodeTest-350644894 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:49:43 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-32f33439-6ef4-4505-9cca-edcf17bc4d6f tempest-CinderUnicodeTest-350644894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:49:43 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-32f33439-6ef4-4505-9cca-edcf17bc4d6f tempest-CinderUnicodeTest-350644894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5996e9b-4f09-4fc5-b0a5-9067c25deb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-730ccc89-a930-46be-948a-19f79336a88e', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:43 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-32f33439-6ef4-4505-9cca-edcf17bc4d6f tempest-CinderUnicodeTest-350644894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2720b2ec-2f42-4170-85c5-f0c2ae168183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:43 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-32f33439-6ef4-4505-9cca-edcf17bc4d6f tempest-CinderUnicodeTest-350644894 None] Volume volume-730ccc89-a930-46be-948a-19f79336a88e (730ccc89-a930-46be-948a-19f79336a88e): created successfully
Feb 28 04:49:43 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-32f33439-6ef4-4505-9cca-edcf17bc4d6f tempest-CinderUnicodeTest-350644894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2720b2ec-2f42-4170-85c5-f0c2ae168183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:43 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-32f33439-6ef4-4505-9cca-edcf17bc4d6f tempest-CinderUnicodeTest-350644894 None] Flow 'volume_create_manager' (755bf7e5-8b9f-404f-b58f-5843c9259090) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:49:43 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-32f33439-6ef4-4505-9cca-edcf17bc4d6f tempest-CinderUnicodeTest-350644894 None] Created volume successfully.
Feb 28 04:49:44 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-9936a279-b94d-4641-a3da-78d7724689de tempest-CinderUnicodeTest-350644894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:49:45 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9936a279-b94d-4641-a3da-78d7724689de tempest-CinderUnicodeTest-350644894 None] Flow 'volume_create_manager' (f13f0245-2164-470c-bd0e-6e61378a5df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:49:45 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9936a279-b94d-4641-a3da-78d7724689de tempest-CinderUnicodeTest-350644894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a4471a3-87ec-4fd7-b269-b1c25f9e9563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:45 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9936a279-b94d-4641-a3da-78d7724689de tempest-CinderUnicodeTest-350644894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a4471a3-87ec-4fd7-b269-b1c25f9e9563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:49:45Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2104783550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64e4eb20-f573-4db7-8cff-84e4cae18cab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05aef9d2c87f408b9db1b6be7b84bf1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:49:45Z,use_quota=True,user_id='04e2a04f913848bc88cff8b0ae51a1e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:45 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9936a279-b94d-4641-a3da-78d7724689de tempest-CinderUnicodeTest-350644894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88f65272-0eaa-4486-a30b-a3b26ed7b9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:45 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9936a279-b94d-4641-a3da-78d7724689de tempest-CinderUnicodeTest-350644894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88f65272-0eaa-4486-a30b-a3b26ed7b9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:45 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9936a279-b94d-4641-a3da-78d7724689de tempest-CinderUnicodeTest-350644894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea26259c-8738-462a-80c3-5a57504713f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:45 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9936a279-b94d-4641-a3da-78d7724689de tempest-CinderUnicodeTest-350644894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea26259c-8738-462a-80c3-5a57504713f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64e4eb20-f573-4db7-8cff-84e4cae18cab', 'volume_name': 'volume-64e4eb20-f573-4db7-8cff-84e4cae18cab', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:45 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9936a279-b94d-4641-a3da-78d7724689de tempest-CinderUnicodeTest-350644894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (168c6770-ea09-48e5-bfda-115b86e8858f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:45 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9936a279-b94d-4641-a3da-78d7724689de tempest-CinderUnicodeTest-350644894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (168c6770-ea09-48e5-bfda-115b86e8858f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:45 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9936a279-b94d-4641-a3da-78d7724689de tempest-CinderUnicodeTest-350644894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cb8a3e2-27f5-4a5d-a219-36faf183b1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:45 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-9936a279-b94d-4641-a3da-78d7724689de tempest-CinderUnicodeTest-350644894 None] Volume 64e4eb20-f573-4db7-8cff-84e4cae18cab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64e4eb20-f573-4db7-8cff-84e4cae18cab', 'volume_size': 1}
Feb 28 04:49:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-9936a279-b94d-4641-a3da-78d7724689de tempest-CinderUnicodeTest-350644894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:49:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-9936a279-b94d-4641-a3da-78d7724689de tempest-CinderUnicodeTest-350644894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:49:45 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-9936a279-b94d-4641-a3da-78d7724689de tempest-CinderUnicodeTest-350644894 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:49:45Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2104783550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64e4eb20-f573-4db7-8cff-84e4cae18cab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05aef9d2c87f408b9db1b6be7b84bf1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:49:45Z,use_quota=True,user_id='04e2a04f913848bc88cff8b0ae51a1e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:49:45 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-9936a279-b94d-4641-a3da-78d7724689de tempest-CinderUnicodeTest-350644894 None] Creating volume 64e4eb20-f573-4db7-8cff-84e4cae18cab {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:49:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-9936a279-b94d-4641-a3da-78d7724689de tempest-CinderUnicodeTest-350644894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:49:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-9936a279-b94d-4641-a3da-78d7724689de tempest-CinderUnicodeTest-350644894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:49:45 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-9936a279-b94d-4641-a3da-78d7724689de tempest-CinderUnicodeTest-350644894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:49:45 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-9936a279-b94d-4641-a3da-78d7724689de tempest-CinderUnicodeTest-350644894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:49:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-9936a279-b94d-4641-a3da-78d7724689de tempest-CinderUnicodeTest-350644894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:49:45 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-9936a279-b94d-4641-a3da-78d7724689de tempest-CinderUnicodeTest-350644894 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:49:45 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-9936a279-b94d-4641-a3da-78d7724689de tempest-CinderUnicodeTest-350644894 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:49:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9936a279-b94d-4641-a3da-78d7724689de tempest-CinderUnicodeTest-350644894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:45 devstack sudo[91182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab 1073741824
Feb 28 04:49:45 devstack sudo[91182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:45 devstack sudo[91182]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9936a279-b94d-4641-a3da-78d7724689de tempest-CinderUnicodeTest-350644894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab 1073741824" returned: 0 in 0.484s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9936a279-b94d-4641-a3da-78d7724689de tempest-CinderUnicodeTest-350644894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:45 devstack sudo[91187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab
Feb 28 04:49:45 devstack sudo[91187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:45 devstack sudo[91187]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9936a279-b94d-4641-a3da-78d7724689de tempest-CinderUnicodeTest-350644894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab" returned: 0 in 0.398s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:45 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-9936a279-b94d-4641-a3da-78d7724689de tempest-CinderUnicodeTest-350644894 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:49:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-9936a279-b94d-4641-a3da-78d7724689de tempest-CinderUnicodeTest-350644894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:49:45 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9936a279-b94d-4641-a3da-78d7724689de tempest-CinderUnicodeTest-350644894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cb8a3e2-27f5-4a5d-a219-36faf183b1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64e4eb20-f573-4db7-8cff-84e4cae18cab', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:45 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9936a279-b94d-4641-a3da-78d7724689de tempest-CinderUnicodeTest-350644894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ac692c-f994-4944-ac7f-a8a7f47adef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:49:45 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-9936a279-b94d-4641-a3da-78d7724689de tempest-CinderUnicodeTest-350644894 None] Volume volume-64e4eb20-f573-4db7-8cff-84e4cae18cab (64e4eb20-f573-4db7-8cff-84e4cae18cab): created successfully
Feb 28 04:49:45 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9936a279-b94d-4641-a3da-78d7724689de tempest-CinderUnicodeTest-350644894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ac692c-f994-4944-ac7f-a8a7f47adef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:49:45 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9936a279-b94d-4641-a3da-78d7724689de tempest-CinderUnicodeTest-350644894 None] Flow 'volume_create_manager' (f13f0245-2164-470c-bd0e-6e61378a5df9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:49:45 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-9936a279-b94d-4641-a3da-78d7724689de tempest-CinderUnicodeTest-350644894 None] Created volume successfully.
Feb 28 04:49:46 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ef818753-69ca-4c37-ab1f-8fcf38c32df3 tempest-CinderUnicodeTest-350644894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:49:46 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ef818753-69ca-4c37-ab1f-8fcf38c32df3 tempest-CinderUnicodeTest-350644894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:49:46 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-ef818753-69ca-4c37-ab1f-8fcf38c32df3 tempest-CinderUnicodeTest-350644894 None] Creating offline snapshot ea370c94-d2ac-4e7d-b6d7-17a8ac518667 of volume 64e4eb20-f573-4db7-8cff-84e4cae18cab {{(pid=84248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 04:49:46 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[718de08f-039a-4fe6-a977-d4ac4ba02859]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:49:46 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ef818753-69ca-4c37-ab1f-8fcf38c32df3 tempest-CinderUnicodeTest-350644894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:46 devstack sudo[91190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab
Feb 28 04:49:46 devstack sudo[91190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:46 devstack sudo[91190]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:46 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ef818753-69ca-4c37-ab1f-8fcf38c32df3 tempest-CinderUnicodeTest-350644894 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab" returned: 0 in 0.461s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:46 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ef818753-69ca-4c37-ab1f-8fcf38c32df3 tempest-CinderUnicodeTest-350644894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab.ea370c94-d2ac-4e7d-b6d7-17a8ac518667 1G {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:46 devstack sudo[91195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab.ea370c94-d2ac-4e7d-b6d7-17a8ac518667 1G
Feb 28 04:49:46 devstack sudo[91195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:47 devstack sudo[91195]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:47 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ef818753-69ca-4c37-ab1f-8fcf38c32df3 tempest-CinderUnicodeTest-350644894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab.ea370c94-d2ac-4e7d-b6d7-17a8ac518667 1G" returned: 0 in 0.454s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:47 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ef818753-69ca-4c37-ab1f-8fcf38c32df3 tempest-CinderUnicodeTest-350644894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64e4eb20-f573-4db7-8cff-84e4cae18cab -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab.ea370c94-d2ac-4e7d-b6d7-17a8ac518667 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:47 devstack sudo[91200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64e4eb20-f573-4db7-8cff-84e4cae18cab -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab.ea370c94-d2ac-4e7d-b6d7-17a8ac518667
Feb 28 04:49:47 devstack sudo[91200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:47 devstack sudo[91200]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:47 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ef818753-69ca-4c37-ab1f-8fcf38c32df3 tempest-CinderUnicodeTest-350644894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64e4eb20-f573-4db7-8cff-84e4cae18cab -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab.ea370c94-d2ac-4e7d-b6d7-17a8ac518667" returned: 0 in 0.417s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:47 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-ef818753-69ca-4c37-ab1f-8fcf38c32df3 tempest-CinderUnicodeTest-350644894 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab.ea370c94-d2ac-4e7d-b6d7-17a8ac518667 is being set with open permissions: ugo+rw
Feb 28 04:49:47 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ef818753-69ca-4c37-ab1f-8fcf38c32df3 tempest-CinderUnicodeTest-350644894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab.ea370c94-d2ac-4e7d-b6d7-17a8ac518667 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:47 devstack sudo[91205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab.ea370c94-d2ac-4e7d-b6d7-17a8ac518667
Feb 28 04:49:47 devstack sudo[91205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:47 devstack sudo[91205]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:47 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ef818753-69ca-4c37-ab1f-8fcf38c32df3 tempest-CinderUnicodeTest-350644894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab.ea370c94-d2ac-4e7d-b6d7-17a8ac518667" returned: 0 in 0.394s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:47 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ef818753-69ca-4c37-ab1f-8fcf38c32df3 tempest-CinderUnicodeTest-350644894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:48 devstack sudo[91208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab.info
Feb 28 04:49:48 devstack sudo[91208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:48 devstack sudo[91208]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:48 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ef818753-69ca-4c37-ab1f-8fcf38c32df3 tempest-CinderUnicodeTest-350644894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab.info" returned: 0 in 0.397s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:48 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-ef818753-69ca-4c37-ab1f-8fcf38c32df3 tempest-CinderUnicodeTest-350644894 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab.info is being set with open permissions: ugo+rw
Feb 28 04:49:48 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ef818753-69ca-4c37-ab1f-8fcf38c32df3 tempest-CinderUnicodeTest-350644894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:48 devstack sudo[91211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab.info
Feb 28 04:49:48 devstack sudo[91211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:48 devstack sudo[91211]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:48 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ef818753-69ca-4c37-ab1f-8fcf38c32df3 tempest-CinderUnicodeTest-350644894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab.info" returned: 0 in 0.390s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:48 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ef818753-69ca-4c37-ab1f-8fcf38c32df3 tempest-CinderUnicodeTest-350644894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.570s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:49:48 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-ef818753-69ca-4c37-ab1f-8fcf38c32df3 tempest-CinderUnicodeTest-350644894 None] Create snapshot completed successfully
Feb 28 04:49:49 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-e8f3c70f-2628-4371-aea9-4cf928434445 tempest-CinderUnicodeTest-350644894 None] Acquiring lock "cinder-ea370c94-d2ac-4e7d-b6d7-17a8ac518667-delete_snapshot" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:49:49 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-e8f3c70f-2628-4371-aea9-4cf928434445 tempest-CinderUnicodeTest-350644894 None] Lock "cinder-ea370c94-d2ac-4e7d-b6d7-17a8ac518667-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:49:49 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-e8f3c70f-2628-4371-aea9-4cf928434445 tempest-CinderUnicodeTest-350644894 None] Acquiring lock "cinder-quobyte-64e4eb20-f573-4db7-8cff-84e4cae18cab" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:49:49 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-e8f3c70f-2628-4371-aea9-4cf928434445 tempest-CinderUnicodeTest-350644894 None] Lock "cinder-quobyte-64e4eb20-f573-4db7-8cff-84e4cae18cab" acquired by "delete_snapshot" :: waited 0.006s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:49:49 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-e8f3c70f-2628-4371-aea9-4cf928434445 tempest-CinderUnicodeTest-350644894 None] Acquiring lock "cinder-quobyte-ea370c94-d2ac-4e7d-b6d7-17a8ac518667" by "_delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:49:49 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-e8f3c70f-2628-4371-aea9-4cf928434445 tempest-CinderUnicodeTest-350644894 None] Lock "cinder-quobyte-ea370c94-d2ac-4e7d-b6d7-17a8ac518667" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:49:49 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-e8f3c70f-2628-4371-aea9-4cf928434445 tempest-CinderUnicodeTest-350644894 None] Deleting offline snapshot ea370c94-d2ac-4e7d-b6d7-17a8ac518667 of volume 64e4eb20-f573-4db7-8cff-84e4cae18cab {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 04:49:49 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-e8f3c70f-2628-4371-aea9-4cf928434445 tempest-CinderUnicodeTest-350644894 None] snapshot_file for this snap is: volume-64e4eb20-f573-4db7-8cff-84e4cae18cab.ea370c94-d2ac-4e7d-b6d7-17a8ac518667 {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 04:49:49 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f9b8e9-5c27-4a0a-8a75-5af891617262]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:49:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e8f3c70f-2628-4371-aea9-4cf928434445 tempest-CinderUnicodeTest-350644894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab.ea370c94-d2ac-4e7d-b6d7-17a8ac518667 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:49 devstack sudo[91214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab.ea370c94-d2ac-4e7d-b6d7-17a8ac518667
Feb 28 04:49:49 devstack sudo[91214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:49 devstack sudo[91214]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e8f3c70f-2628-4371-aea9-4cf928434445 tempest-CinderUnicodeTest-350644894 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab.ea370c94-d2ac-4e7d-b6d7-17a8ac518667" returned: 0 in 0.471s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:49 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-e8f3c70f-2628-4371-aea9-4cf928434445 tempest-CinderUnicodeTest-350644894 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64e4eb20-f573-4db7-8cff-84e4cae18cab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:49:49 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53d1197-930b-4dd9-bdb0-a8c3ac03feb8]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:49:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e8f3c70f-2628-4371-aea9-4cf928434445 tempest-CinderUnicodeTest-350644894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:49 devstack sudo[91220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab
Feb 28 04:49:49 devstack sudo[91220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:50 devstack sudo[91220]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e8f3c70f-2628-4371-aea9-4cf928434445 tempest-CinderUnicodeTest-350644894 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab" returned: 0 in 0.461s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e8f3c70f-2628-4371-aea9-4cf928434445 tempest-CinderUnicodeTest-350644894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab.ea370c94-d2ac-4e7d-b6d7-17a8ac518667 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:50 devstack sudo[91225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab.ea370c94-d2ac-4e7d-b6d7-17a8ac518667
Feb 28 04:49:50 devstack sudo[91225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:50 devstack sudo[91225]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e8f3c70f-2628-4371-aea9-4cf928434445 tempest-CinderUnicodeTest-350644894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab.ea370c94-d2ac-4e7d-b6d7-17a8ac518667" returned: 0 in 0.445s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e8f3c70f-2628-4371-aea9-4cf928434445 tempest-CinderUnicodeTest-350644894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab.ea370c94-d2ac-4e7d-b6d7-17a8ac518667 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:50 devstack sudo[91230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab.ea370c94-d2ac-4e7d-b6d7-17a8ac518667
Feb 28 04:49:50 devstack sudo[91230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:51 devstack sudo[91230]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e8f3c70f-2628-4371-aea9-4cf928434445 tempest-CinderUnicodeTest-350644894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab.ea370c94-d2ac-4e7d-b6d7-17a8ac518667" returned: 0 in 0.411s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:51 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-e8f3c70f-2628-4371-aea9-4cf928434445 tempest-CinderUnicodeTest-350644894 None] Lock "cinder-quobyte-ea370c94-d2ac-4e7d-b6d7-17a8ac518667" released by "_delete_snapshot" :: held 1.842s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:49:51 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-e8f3c70f-2628-4371-aea9-4cf928434445 tempest-CinderUnicodeTest-350644894 None] Lock "cinder-quobyte-64e4eb20-f573-4db7-8cff-84e4cae18cab" released by "delete_snapshot" :: held 1.858s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:49:51 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-e8f3c70f-2628-4371-aea9-4cf928434445 tempest-CinderUnicodeTest-350644894 None] Created reservations ['b1cdad1a-5a80-4f91-88e5-52bf7172a755', '3c10776a-7895-4573-8c1b-49d0e2626f5d', 'd3ce56db-2844-4cbf-96e2-3ae170d7ae30', '341bf6d2-ae6c-484e-8830-1f7c8ae23d24'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:49:51 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-e8f3c70f-2628-4371-aea9-4cf928434445 tempest-CinderUnicodeTest-350644894 None] Delete snapshot completed successfully.
Feb 28 04:49:51 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-e8f3c70f-2628-4371-aea9-4cf928434445 tempest-CinderUnicodeTest-350644894 None] Lock "cinder-ea370c94-d2ac-4e7d-b6d7-17a8ac518667-delete_snapshot" released by "delete_snapshot" :: held 1.935s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:49:51 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-70f5d523-b76f-4e6d-80a0-4d6a3779dc4a tempest-CinderUnicodeTest-350644894 None] Acquiring lock "cinder-64e4eb20-f573-4db7-8cff-84e4cae18cab-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:49:51 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-70f5d523-b76f-4e6d-80a0-4d6a3779dc4a tempest-CinderUnicodeTest-350644894 None] Lock "cinder-64e4eb20-f573-4db7-8cff-84e4cae18cab-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:49:51 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-70f5d523-b76f-4e6d-80a0-4d6a3779dc4a tempest-CinderUnicodeTest-350644894 None] Acquiring lock "cinder-quobyte-64e4eb20-f573-4db7-8cff-84e4cae18cab" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:49:51 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-70f5d523-b76f-4e6d-80a0-4d6a3779dc4a tempest-CinderUnicodeTest-350644894 None] Lock "cinder-quobyte-64e4eb20-f573-4db7-8cff-84e4cae18cab" acquired by "delete_volume" :: waited 0.013s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:49:51 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f843f6-3d40-4b5b-9e30-9d39f95b7e6f]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:49:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-70f5d523-b76f-4e6d-80a0-4d6a3779dc4a tempest-CinderUnicodeTest-350644894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:51 devstack sudo[91234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab
Feb 28 04:49:51 devstack sudo[91234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:52 devstack sudo[91234]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-70f5d523-b76f-4e6d-80a0-4d6a3779dc4a tempest-CinderUnicodeTest-350644894 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab" returned: 0 in 0.459s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-70f5d523-b76f-4e6d-80a0-4d6a3779dc4a tempest-CinderUnicodeTest-350644894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:52 devstack sudo[91240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab
Feb 28 04:49:52 devstack sudo[91240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:52 devstack sudo[91240]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-70f5d523-b76f-4e6d-80a0-4d6a3779dc4a tempest-CinderUnicodeTest-350644894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-64e4eb20-f573-4db7-8cff-84e4cae18cab" returned: 0 in 0.407s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:52 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-70f5d523-b76f-4e6d-80a0-4d6a3779dc4a tempest-CinderUnicodeTest-350644894 None] Lock "cinder-quobyte-64e4eb20-f573-4db7-8cff-84e4cae18cab" released by "delete_volume" :: held 0.897s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:49:52 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-70f5d523-b76f-4e6d-80a0-4d6a3779dc4a tempest-CinderUnicodeTest-350644894 None] Created reservations ['4a16f8c3-681f-4782-a5e8-a7a4be268cfb', '9ca5706a-c5f9-4f4d-a0e9-d2012d8bc53e', '379fe176-f6fc-42c7-9d71-5075e6005903', 'bbc227b1-d0de-402d-8bde-23341eed3921'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:49:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-70f5d523-b76f-4e6d-80a0-4d6a3779dc4a tempest-CinderUnicodeTest-350644894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:49:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-70f5d523-b76f-4e6d-80a0-4d6a3779dc4a tempest-CinderUnicodeTest-350644894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:49:52 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-70f5d523-b76f-4e6d-80a0-4d6a3779dc4a tempest-CinderUnicodeTest-350644894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:49:52 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-70f5d523-b76f-4e6d-80a0-4d6a3779dc4a tempest-CinderUnicodeTest-350644894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:49:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-70f5d523-b76f-4e6d-80a0-4d6a3779dc4a tempest-CinderUnicodeTest-350644894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:49:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-70f5d523-b76f-4e6d-80a0-4d6a3779dc4a tempest-CinderUnicodeTest-350644894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:52 devstack sudo[91243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:49:52 devstack sudo[91243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:52 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f830b383-8bdf-45e0-8191-6571a5b5c8dd tempest-CinderUnicodeTest-350644894 None] Acquiring lock "cinder-730ccc89-a930-46be-948a-19f79336a88e-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:49:52 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f830b383-8bdf-45e0-8191-6571a5b5c8dd tempest-CinderUnicodeTest-350644894 None] Lock "cinder-730ccc89-a930-46be-948a-19f79336a88e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:49:52 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f830b383-8bdf-45e0-8191-6571a5b5c8dd tempest-CinderUnicodeTest-350644894 None] Acquiring lock "cinder-quobyte-730ccc89-a930-46be-948a-19f79336a88e" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:49:52 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f830b383-8bdf-45e0-8191-6571a5b5c8dd tempest-CinderUnicodeTest-350644894 None] Lock "cinder-quobyte-730ccc89-a930-46be-948a-19f79336a88e" acquired by "delete_volume" :: waited 0.007s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:49:52 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[d675555c-0e49-4c2a-99ec-ea0917b690b6]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:49:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f830b383-8bdf-45e0-8191-6571a5b5c8dd tempest-CinderUnicodeTest-350644894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-730ccc89-a930-46be-948a-19f79336a88e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:52 devstack sudo[91245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-730ccc89-a930-46be-948a-19f79336a88e
Feb 28 04:49:52 devstack sudo[91245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:52 devstack sudo[91243]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-70f5d523-b76f-4e6d-80a0-4d6a3779dc4a tempest-CinderUnicodeTest-350644894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.421s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:52 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-70f5d523-b76f-4e6d-80a0-4d6a3779dc4a tempest-CinderUnicodeTest-350644894 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:49:52 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-70f5d523-b76f-4e6d-80a0-4d6a3779dc4a tempest-CinderUnicodeTest-350644894 None] Deleted volume successfully.
Feb 28 04:49:52 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-70f5d523-b76f-4e6d-80a0-4d6a3779dc4a tempest-CinderUnicodeTest-350644894 None] Lock "cinder-64e4eb20-f573-4db7-8cff-84e4cae18cab-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:49:53 devstack sudo[91245]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f830b383-8bdf-45e0-8191-6571a5b5c8dd tempest-CinderUnicodeTest-350644894 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-730ccc89-a930-46be-948a-19f79336a88e" returned: 0 in 0.470s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f830b383-8bdf-45e0-8191-6571a5b5c8dd tempest-CinderUnicodeTest-350644894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-730ccc89-a930-46be-948a-19f79336a88e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:53 devstack sudo[91251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-730ccc89-a930-46be-948a-19f79336a88e
Feb 28 04:49:53 devstack sudo[91251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:53 devstack sudo[91251]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f830b383-8bdf-45e0-8191-6571a5b5c8dd tempest-CinderUnicodeTest-350644894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-730ccc89-a930-46be-948a-19f79336a88e" returned: 0 in 0.399s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:53 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f830b383-8bdf-45e0-8191-6571a5b5c8dd tempest-CinderUnicodeTest-350644894 None] Lock "cinder-quobyte-730ccc89-a930-46be-948a-19f79336a88e" released by "delete_volume" :: held 0.897s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:49:53 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-f830b383-8bdf-45e0-8191-6571a5b5c8dd tempest-CinderUnicodeTest-350644894 None] Created reservations ['f79d9b89-6dd4-4411-b999-439383d8252f', '1caf36a8-72ee-48d1-8e8c-6641a0096911', '3ce9ca9f-1854-4233-b1e6-ac9d7875afe5', '48818a00-4f52-46e8-9251-e646ec9ac6e9'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:49:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-f830b383-8bdf-45e0-8191-6571a5b5c8dd tempest-CinderUnicodeTest-350644894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:49:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-f830b383-8bdf-45e0-8191-6571a5b5c8dd tempest-CinderUnicodeTest-350644894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:49:53 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-f830b383-8bdf-45e0-8191-6571a5b5c8dd tempest-CinderUnicodeTest-350644894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:49:53 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-f830b383-8bdf-45e0-8191-6571a5b5c8dd tempest-CinderUnicodeTest-350644894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:49:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-f830b383-8bdf-45e0-8191-6571a5b5c8dd tempest-CinderUnicodeTest-350644894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:49:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f830b383-8bdf-45e0-8191-6571a5b5c8dd tempest-CinderUnicodeTest-350644894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:49:53 devstack sudo[91254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:49:53 devstack sudo[91254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:49:54 devstack sudo[91254]: pam_unix(sudo:session): session closed for user root
Feb 28 04:49:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f830b383-8bdf-45e0-8191-6571a5b5c8dd tempest-CinderUnicodeTest-350644894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.459s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:49:54 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-f830b383-8bdf-45e0-8191-6571a5b5c8dd tempest-CinderUnicodeTest-350644894 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:49:54 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-f830b383-8bdf-45e0-8191-6571a5b5c8dd tempest-CinderUnicodeTest-350644894 None] Deleted volume successfully.
Feb 28 04:49:54 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f830b383-8bdf-45e0-8191-6571a5b5c8dd tempest-CinderUnicodeTest-350644894 None] Lock "cinder-730ccc89-a930-46be-948a-19f79336a88e-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:00 devstack cinder-volume[84248]: DEBUG dbcounter [-] [84248] Writing DB stats cinder:SELECT=113,cinder:INSERT=45,cinder:UPDATE=158,cinder:DELETE=20 {{(pid=84248) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 04:50:00 devstack cinder-volume[84248]: DEBUG dbcounter [-] [84248] Writing DB stats cinder:UPDATE=195,cinder:SELECT=130,cinder:INSERT=39,cinder:DELETE=11 {{(pid=84248) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 04:50:00 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f501567-1206-436d-8a61-baddf3951764 tempest-VolumeDependencyTests-581964465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:50:00 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-7f501567-1206-436d-8a61-baddf3951764 tempest-VolumeDependencyTests-581964465 None] Flow 'volume_create_manager' (17aac8d1-d4bb-4080-817f-2922eab3c665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:00 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-7f501567-1206-436d-8a61-baddf3951764 tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99a160fe-5d59-4dee-bfd6-eb19fa5e5a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:00 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-7f501567-1206-436d-8a61-baddf3951764 tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99a160fe-5d59-4dee-bfd6-eb19fa5e5a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-200918084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cc32111-3c25-4f27-ad03-fb7fa45952b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a88a855c6524bad869cffeef21a285b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:01Z,use_quota=True,user_id='37cf0981063b41cd9dda2cbc314a761f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:00 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-7f501567-1206-436d-8a61-baddf3951764 tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cd3ac2a-47a2-4482-bef4-7d2149693f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:00 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-7f501567-1206-436d-8a61-baddf3951764 tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cd3ac2a-47a2-4482-bef4-7d2149693f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:00 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-7f501567-1206-436d-8a61-baddf3951764 tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c57b8fd-50e3-4a87-8695-6a2b4af7c901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:00 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-7f501567-1206-436d-8a61-baddf3951764 tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c57b8fd-50e3-4a87-8695-6a2b4af7c901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cc32111-3c25-4f27-ad03-fb7fa45952b2', 'volume_name': 'volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:00 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-7f501567-1206-436d-8a61-baddf3951764 tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7121449b-ebab-41dd-9ddf-42ca00c2dca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:00 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-7f501567-1206-436d-8a61-baddf3951764 tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7121449b-ebab-41dd-9ddf-42ca00c2dca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:00 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-7f501567-1206-436d-8a61-baddf3951764 tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3d23f79-41b5-4fdf-9ff9-4920c2e51042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:00 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-7f501567-1206-436d-8a61-baddf3951764 tempest-VolumeDependencyTests-581964465 None] Volume 8cc32111-3c25-4f27-ad03-fb7fa45952b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2', 'volume_size': 1}
Feb 28 04:50:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-7f501567-1206-436d-8a61-baddf3951764 tempest-VolumeDependencyTests-581964465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-7f501567-1206-436d-8a61-baddf3951764 tempest-VolumeDependencyTests-581964465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:00 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-7f501567-1206-436d-8a61-baddf3951764 tempest-VolumeDependencyTests-581964465 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-200918084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cc32111-3c25-4f27-ad03-fb7fa45952b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a88a855c6524bad869cffeef21a285b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:01Z,use_quota=True,user_id='37cf0981063b41cd9dda2cbc314a761f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:50:00 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-7f501567-1206-436d-8a61-baddf3951764 tempest-VolumeDependencyTests-581964465 None] Creating volume 8cc32111-3c25-4f27-ad03-fb7fa45952b2 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:50:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-7f501567-1206-436d-8a61-baddf3951764 tempest-VolumeDependencyTests-581964465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-7f501567-1206-436d-8a61-baddf3951764 tempest-VolumeDependencyTests-581964465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:00 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-7f501567-1206-436d-8a61-baddf3951764 tempest-VolumeDependencyTests-581964465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:00 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-7f501567-1206-436d-8a61-baddf3951764 tempest-VolumeDependencyTests-581964465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-7f501567-1206-436d-8a61-baddf3951764 tempest-VolumeDependencyTests-581964465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:00 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-7f501567-1206-436d-8a61-baddf3951764 tempest-VolumeDependencyTests-581964465 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:50:00 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-7f501567-1206-436d-8a61-baddf3951764 tempest-VolumeDependencyTests-581964465 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:50:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7f501567-1206-436d-8a61-baddf3951764 tempest-VolumeDependencyTests-581964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:00 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-db28510b-3b49-44af-84c0-d6489a7979b0 tempest-CreateVolumesFromImageTest-1358643878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:50:00 devstack sudo[91299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2 1073741824
Feb 28 04:50:00 devstack sudo[91299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:00 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-db28510b-3b49-44af-84c0-d6489a7979b0 tempest-CreateVolumesFromImageTest-1358643878 None] Flow 'volume_create_manager' (3eab6396-0cc1-4456-b25d-38897ccc18fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:00 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-db28510b-3b49-44af-84c0-d6489a7979b0 tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78291b69-7afa-4b26-a895-5260aee49956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-db28510b-3b49-44af-84c0-d6489a7979b0 tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78291b69-7afa-4b26-a895-5260aee49956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1266591303',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e7a479f-5ef3-407c-beaa-da40cb458453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06d9ba5789a0460c81bb8106dac050e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:01Z,use_quota=True,user_id='1fa075cbb10d4b47ab132524f8b93053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-db28510b-3b49-44af-84c0-d6489a7979b0 tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5b771cb-6450-4f3c-83fb-ec4a99afe075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-db28510b-3b49-44af-84c0-d6489a7979b0 tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5b771cb-6450-4f3c-83fb-ec4a99afe075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-db28510b-3b49-44af-84c0-d6489a7979b0 tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13f65a7c-7ef3-48c4-8604-0d34356f365a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-db28510b-3b49-44af-84c0-d6489a7979b0 tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13f65a7c-7ef3-48c4-8604-0d34356f365a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e7a479f-5ef3-407c-beaa-da40cb458453', 'volume_name': 'volume-6e7a479f-5ef3-407c-beaa-da40cb458453', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-db28510b-3b49-44af-84c0-d6489a7979b0 tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d04f7f6a-3fa0-42ab-8c82-b8303b339351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-db28510b-3b49-44af-84c0-d6489a7979b0 tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d04f7f6a-3fa0-42ab-8c82-b8303b339351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-db28510b-3b49-44af-84c0-d6489a7979b0 tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (932f1b86-f5b5-488f-9725-a85c5291b667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:01 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-db28510b-3b49-44af-84c0-d6489a7979b0 tempest-CreateVolumesFromImageTest-1358643878 None] Volume 6e7a479f-5ef3-407c-beaa-da40cb458453: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e7a479f-5ef3-407c-beaa-da40cb458453', 'volume_size': 1}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-db28510b-3b49-44af-84c0-d6489a7979b0 tempest-CreateVolumesFromImageTest-1358643878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-23442ca6-b019-4dcf-b63a-9fe241e51bfe tempest-CreateVolumesFromSnapshotTest-1134726136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-23442ca6-b019-4dcf-b63a-9fe241e51bfe tempest-CreateVolumesFromSnapshotTest-1134726136 None] Flow 'volume_create_manager' (cb079605-735c-4e82-a1c0-efe3a136126d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-23442ca6-b019-4dcf-b63a-9fe241e51bfe tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60edf347-fa88-45d2-8a9b-c3368d782455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-23442ca6-b019-4dcf-b63a-9fe241e51bfe tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60edf347-fa88-45d2-8a9b-c3368d782455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1327057562',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73d57c89-7228-43e4-ae94-e3cc2e050144,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7196b4e67ebe4b2299bda8f580d0f770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:01Z,use_quota=True,user_id='eaa4bc1ff9d04c4bac02fa29ede04085',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-23442ca6-b019-4dcf-b63a-9fe241e51bfe tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e7d97b-3169-49f1-ac31-6984a4514222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-23442ca6-b019-4dcf-b63a-9fe241e51bfe tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e7d97b-3169-49f1-ac31-6984a4514222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-23442ca6-b019-4dcf-b63a-9fe241e51bfe tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa5572ca-e88a-4f00-98d8-353bff545436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-23442ca6-b019-4dcf-b63a-9fe241e51bfe tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa5572ca-e88a-4f00-98d8-353bff545436) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73d57c89-7228-43e4-ae94-e3cc2e050144', 'volume_name': 'volume-73d57c89-7228-43e4-ae94-e3cc2e050144', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-23442ca6-b019-4dcf-b63a-9fe241e51bfe tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6426a766-6acc-4009-a967-2f05a4d130e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-23442ca6-b019-4dcf-b63a-9fe241e51bfe tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6426a766-6acc-4009-a967-2f05a4d130e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-23442ca6-b019-4dcf-b63a-9fe241e51bfe tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211cd0e4-ff4f-4afc-9910-beb1aa8bbeac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:01 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-23442ca6-b019-4dcf-b63a-9fe241e51bfe tempest-CreateVolumesFromSnapshotTest-1134726136 None] Volume 73d57c89-7228-43e4-ae94-e3cc2e050144: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73d57c89-7228-43e4-ae94-e3cc2e050144', 'volume_size': 1}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-23442ca6-b019-4dcf-b63a-9fe241e51bfe tempest-CreateVolumesFromSnapshotTest-1134726136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c322bad-1c75-4792-82ef-30686446f10c tempest-CreateVolumesFromImageTest-1358643878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6c322bad-1c75-4792-82ef-30686446f10c tempest-CreateVolumesFromImageTest-1358643878 None] Flow 'volume_create_manager' (7dd6378f-1853-4b1c-ad6f-998c98774b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6c322bad-1c75-4792-82ef-30686446f10c tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc14428e-ba35-4625-aea7-76685c947db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6c322bad-1c75-4792-82ef-30686446f10c tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc14428e-ba35-4625-aea7-76685c947db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-780267192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26ec2009-a4f7-45ac-9ab3-5f4dc1de6f07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06d9ba5789a0460c81bb8106dac050e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:01Z,use_quota=True,user_id='1fa075cbb10d4b47ab132524f8b93053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6c322bad-1c75-4792-82ef-30686446f10c tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd0e7147-a708-425d-85aa-3c4bce155013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6c322bad-1c75-4792-82ef-30686446f10c tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd0e7147-a708-425d-85aa-3c4bce155013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6c322bad-1c75-4792-82ef-30686446f10c tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40da5058-e4a8-4ba3-b833-b9149adba1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6c322bad-1c75-4792-82ef-30686446f10c tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40da5058-e4a8-4ba3-b833-b9149adba1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26ec2009-a4f7-45ac-9ab3-5f4dc1de6f07', 'volume_name': 'volume-26ec2009-a4f7-45ac-9ab3-5f4dc1de6f07', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6c322bad-1c75-4792-82ef-30686446f10c tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (044e315d-f311-4c43-831d-9403e4e89b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6c322bad-1c75-4792-82ef-30686446f10c tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (044e315d-f311-4c43-831d-9403e4e89b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6c322bad-1c75-4792-82ef-30686446f10c tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (006f0ea3-e2e0-468d-9d5b-3229a2e4cdd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:01 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-6c322bad-1c75-4792-82ef-30686446f10c tempest-CreateVolumesFromImageTest-1358643878 None] Volume 26ec2009-a4f7-45ac-9ab3-5f4dc1de6f07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26ec2009-a4f7-45ac-9ab3-5f4dc1de6f07', 'volume_size': 1}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-6c322bad-1c75-4792-82ef-30686446f10c tempest-CreateVolumesFromImageTest-1358643878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb970409-4588-44af-926d-9c5d286f0b85 tempest-CreateVolumesFromImageTest-1358643878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-cb970409-4588-44af-926d-9c5d286f0b85 tempest-CreateVolumesFromImageTest-1358643878 None] Flow 'volume_create_manager' (befefa95-cab3-4196-9166-0b7f4ab0aa1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-cb970409-4588-44af-926d-9c5d286f0b85 tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7741bc42-28cc-4bef-8c3c-a60afaa9b835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-cb970409-4588-44af-926d-9c5d286f0b85 tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7741bc42-28cc-4bef-8c3c-a60afaa9b835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-356871993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c794c051-4e71-4274-a981-62b20bf6be43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06d9ba5789a0460c81bb8106dac050e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:01Z,use_quota=True,user_id='1fa075cbb10d4b47ab132524f8b93053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-cb970409-4588-44af-926d-9c5d286f0b85 tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b791f22-1383-4722-bf2a-19db0b1ccf45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-cb970409-4588-44af-926d-9c5d286f0b85 tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b791f22-1383-4722-bf2a-19db0b1ccf45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-cb970409-4588-44af-926d-9c5d286f0b85 tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1378f6cd-2f9e-43a9-a678-7e9b80d2d33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-cb970409-4588-44af-926d-9c5d286f0b85 tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1378f6cd-2f9e-43a9-a678-7e9b80d2d33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c794c051-4e71-4274-a981-62b20bf6be43', 'volume_name': 'volume-c794c051-4e71-4274-a981-62b20bf6be43', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-cb970409-4588-44af-926d-9c5d286f0b85 tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8587fef-ecbe-4962-93fe-82af1c1735e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-cb970409-4588-44af-926d-9c5d286f0b85 tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8587fef-ecbe-4962-93fe-82af1c1735e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-cb970409-4588-44af-926d-9c5d286f0b85 tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67fc47aa-08d6-4843-b2a9-3f350cb073d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:01 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-cb970409-4588-44af-926d-9c5d286f0b85 tempest-CreateVolumesFromImageTest-1358643878 None] Volume c794c051-4e71-4274-a981-62b20bf6be43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c794c051-4e71-4274-a981-62b20bf6be43', 'volume_size': 1}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-cb970409-4588-44af-926d-9c5d286f0b85 tempest-CreateVolumesFromImageTest-1358643878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3b58ea1-72dd-4eaa-9793-5f0d25ecdbdd tempest-CreateVolumesFromImageTest-1358643878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d3b58ea1-72dd-4eaa-9793-5f0d25ecdbdd tempest-CreateVolumesFromImageTest-1358643878 None] Flow 'volume_create_manager' (0149a3e7-d93c-4662-8b46-d7e675c4e274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d3b58ea1-72dd-4eaa-9793-5f0d25ecdbdd tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f5980ff-95bf-45ef-86d6-7e5f833d6e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d3b58ea1-72dd-4eaa-9793-5f0d25ecdbdd tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f5980ff-95bf-45ef-86d6-7e5f833d6e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-267133105',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=693af190-844a-4b23-9c71-49014dc27099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06d9ba5789a0460c81bb8106dac050e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:02Z,use_quota=True,user_id='1fa075cbb10d4b47ab132524f8b93053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d3b58ea1-72dd-4eaa-9793-5f0d25ecdbdd tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11dddc4d-167b-42b1-92a0-78f77da87080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:01 devstack sudo[91299]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d3b58ea1-72dd-4eaa-9793-5f0d25ecdbdd tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11dddc4d-167b-42b1-92a0-78f77da87080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d3b58ea1-72dd-4eaa-9793-5f0d25ecdbdd tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (845a775d-29e0-4bd6-9325-dd3e0c756185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d3b58ea1-72dd-4eaa-9793-5f0d25ecdbdd tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (845a775d-29e0-4bd6-9325-dd3e0c756185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '693af190-844a-4b23-9c71-49014dc27099', 'volume_name': 'volume-693af190-844a-4b23-9c71-49014dc27099', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d3b58ea1-72dd-4eaa-9793-5f0d25ecdbdd tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d60bc8e-22e3-4f87-a9e1-6780c7d5c107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d3b58ea1-72dd-4eaa-9793-5f0d25ecdbdd tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d60bc8e-22e3-4f87-a9e1-6780c7d5c107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d3b58ea1-72dd-4eaa-9793-5f0d25ecdbdd tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5da1716-9afe-4001-9b67-0ca50673a469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:01 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-d3b58ea1-72dd-4eaa-9793-5f0d25ecdbdd tempest-CreateVolumesFromImageTest-1358643878 None] Volume 693af190-844a-4b23-9c71-49014dc27099: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-693af190-844a-4b23-9c71-49014dc27099', 'volume_size': 1}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d3b58ea1-72dd-4eaa-9793-5f0d25ecdbdd tempest-CreateVolumesFromImageTest-1358643878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7f501567-1206-436d-8a61-baddf3951764 tempest-VolumeDependencyTests-581964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2 1073741824" returned: 0 in 0.778s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7f501567-1206-436d-8a61-baddf3951764 tempest-VolumeDependencyTests-581964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:01 devstack sudo[91304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2
Feb 28 04:50:01 devstack sudo[91304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-63489b15-fe49-4fc1-bce5-9fd1e8ecc95c tempest-CreateVolumesFromImageTest-1358643878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-63489b15-fe49-4fc1-bce5-9fd1e8ecc95c tempest-CreateVolumesFromImageTest-1358643878 None] Flow 'volume_create_manager' (8b964d75-23fa-4f8a-85b5-1f745bf06fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-63489b15-fe49-4fc1-bce5-9fd1e8ecc95c tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46479b5e-88e3-4856-861e-ce26008c2cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-63489b15-fe49-4fc1-bce5-9fd1e8ecc95c tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46479b5e-88e3-4856-861e-ce26008c2cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-743143646',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6baa732-d75f-4ef6-836f-ee2140bc92ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06d9ba5789a0460c81bb8106dac050e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:02Z,use_quota=True,user_id='1fa075cbb10d4b47ab132524f8b93053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-63489b15-fe49-4fc1-bce5-9fd1e8ecc95c tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3df9f313-b0eb-4ad2-8aa4-b61dc5ca352b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-63489b15-fe49-4fc1-bce5-9fd1e8ecc95c tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3df9f313-b0eb-4ad2-8aa4-b61dc5ca352b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-63489b15-fe49-4fc1-bce5-9fd1e8ecc95c tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b01c4ee7-25c7-472e-9b71-b1047339882f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-63489b15-fe49-4fc1-bce5-9fd1e8ecc95c tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b01c4ee7-25c7-472e-9b71-b1047339882f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6baa732-d75f-4ef6-836f-ee2140bc92ce', 'volume_name': 'volume-a6baa732-d75f-4ef6-836f-ee2140bc92ce', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-63489b15-fe49-4fc1-bce5-9fd1e8ecc95c tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (401c6bf9-6b92-42c4-ade9-850446bce61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-63489b15-fe49-4fc1-bce5-9fd1e8ecc95c tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (401c6bf9-6b92-42c4-ade9-850446bce61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-63489b15-fe49-4fc1-bce5-9fd1e8ecc95c tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb72d3aa-09c7-413d-a695-8bf957e9078c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:01 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-63489b15-fe49-4fc1-bce5-9fd1e8ecc95c tempest-CreateVolumesFromImageTest-1358643878 None] Volume a6baa732-d75f-4ef6-836f-ee2140bc92ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6baa732-d75f-4ef6-836f-ee2140bc92ce', 'volume_size': 1}
Feb 28 04:50:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-63489b15-fe49-4fc1-bce5-9fd1e8ecc95c tempest-CreateVolumesFromImageTest-1358643878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:02 devstack sudo[91304]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-7f501567-1206-436d-8a61-baddf3951764 tempest-VolumeDependencyTests-581964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2" returned: 0 in 0.479s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:02 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-7f501567-1206-436d-8a61-baddf3951764 tempest-VolumeDependencyTests-581964465 None] <== create_volume: return (1282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:50:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-7f501567-1206-436d-8a61-baddf3951764 tempest-VolumeDependencyTests-581964465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.285s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-db28510b-3b49-44af-84c0-d6489a7979b0 tempest-CreateVolumesFromImageTest-1358643878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.137s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:02 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-db28510b-3b49-44af-84c0-d6489a7979b0 tempest-CreateVolumesFromImageTest-1358643878 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1266591303',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e7a479f-5ef3-407c-beaa-da40cb458453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06d9ba5789a0460c81bb8106dac050e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:01Z,use_quota=True,user_id='1fa075cbb10d4b47ab132524f8b93053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:50:02 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-db28510b-3b49-44af-84c0-d6489a7979b0 tempest-CreateVolumesFromImageTest-1358643878 None] Creating volume 6e7a479f-5ef3-407c-beaa-da40cb458453 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:50:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-db28510b-3b49-44af-84c0-d6489a7979b0 tempest-CreateVolumesFromImageTest-1358643878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-db28510b-3b49-44af-84c0-d6489a7979b0 tempest-CreateVolumesFromImageTest-1358643878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:02 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-db28510b-3b49-44af-84c0-d6489a7979b0 tempest-CreateVolumesFromImageTest-1358643878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:02 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-db28510b-3b49-44af-84c0-d6489a7979b0 tempest-CreateVolumesFromImageTest-1358643878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-db28510b-3b49-44af-84c0-d6489a7979b0 tempest-CreateVolumesFromImageTest-1358643878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:02 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-db28510b-3b49-44af-84c0-d6489a7979b0 tempest-CreateVolumesFromImageTest-1358643878 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:50:02 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-db28510b-3b49-44af-84c0-d6489a7979b0 tempest-CreateVolumesFromImageTest-1358643878 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:50:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-db28510b-3b49-44af-84c0-d6489a7979b0 tempest-CreateVolumesFromImageTest-1358643878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6e7a479f-5ef3-407c-beaa-da40cb458453 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:02 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-7f501567-1206-436d-8a61-baddf3951764 tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3d23f79-41b5-4fdf-9ff9-4920c2e51042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:02 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-7f501567-1206-436d-8a61-baddf3951764 tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0bfeb09-0864-4dfc-9c53-377089c9119e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:02 devstack sudo[91307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6e7a479f-5ef3-407c-beaa-da40cb458453 1073741824
Feb 28 04:50:02 devstack sudo[91307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:02 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-7f501567-1206-436d-8a61-baddf3951764 tempest-VolumeDependencyTests-581964465 None] Volume volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2 (8cc32111-3c25-4f27-ad03-fb7fa45952b2): created successfully
Feb 28 04:50:02 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-7f501567-1206-436d-8a61-baddf3951764 tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0bfeb09-0864-4dfc-9c53-377089c9119e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:02 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-7f501567-1206-436d-8a61-baddf3951764 tempest-VolumeDependencyTests-581964465 None] Flow 'volume_create_manager' (17aac8d1-d4bb-4080-817f-2922eab3c665) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:02 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-7f501567-1206-436d-8a61-baddf3951764 tempest-VolumeDependencyTests-581964465 None] Created volume successfully.
Feb 28 04:50:02 devstack sudo[91307]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-db28510b-3b49-44af-84c0-d6489a7979b0 tempest-CreateVolumesFromImageTest-1358643878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6e7a479f-5ef3-407c-beaa-da40cb458453 1073741824" returned: 0 in 0.498s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-db28510b-3b49-44af-84c0-d6489a7979b0 tempest-CreateVolumesFromImageTest-1358643878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6e7a479f-5ef3-407c-beaa-da40cb458453 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:02 devstack sudo[91312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6e7a479f-5ef3-407c-beaa-da40cb458453
Feb 28 04:50:02 devstack sudo[91312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-917199dd-d27c-4c4d-b799-0fb4ac8a033a tempest-VolumeDependencyTests-581964465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:03 devstack sudo[91312]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-db28510b-3b49-44af-84c0-d6489a7979b0 tempest-CreateVolumesFromImageTest-1358643878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6e7a479f-5ef3-407c-beaa-da40cb458453" returned: 0 in 0.511s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:03 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-db28510b-3b49-44af-84c0-d6489a7979b0 tempest-CreateVolumesFromImageTest-1358643878 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:50:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-db28510b-3b49-44af-84c0-d6489a7979b0 tempest-CreateVolumesFromImageTest-1358643878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-23442ca6-b019-4dcf-b63a-9fe241e51bfe tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.092s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:03 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-23442ca6-b019-4dcf-b63a-9fe241e51bfe tempest-CreateVolumesFromSnapshotTest-1134726136 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1327057562',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73d57c89-7228-43e4-ae94-e3cc2e050144,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7196b4e67ebe4b2299bda8f580d0f770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:01Z,use_quota=True,user_id='eaa4bc1ff9d04c4bac02fa29ede04085',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:50:03 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-23442ca6-b019-4dcf-b63a-9fe241e51bfe tempest-CreateVolumesFromSnapshotTest-1134726136 None] Creating volume 73d57c89-7228-43e4-ae94-e3cc2e050144 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:50:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-23442ca6-b019-4dcf-b63a-9fe241e51bfe tempest-CreateVolumesFromSnapshotTest-1134726136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-23442ca6-b019-4dcf-b63a-9fe241e51bfe tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:03 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-23442ca6-b019-4dcf-b63a-9fe241e51bfe tempest-CreateVolumesFromSnapshotTest-1134726136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:03 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-23442ca6-b019-4dcf-b63a-9fe241e51bfe tempest-CreateVolumesFromSnapshotTest-1134726136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-23442ca6-b019-4dcf-b63a-9fe241e51bfe tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:03 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-23442ca6-b019-4dcf-b63a-9fe241e51bfe tempest-CreateVolumesFromSnapshotTest-1134726136 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:50:03 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-23442ca6-b019-4dcf-b63a-9fe241e51bfe tempest-CreateVolumesFromSnapshotTest-1134726136 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:50:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-23442ca6-b019-4dcf-b63a-9fe241e51bfe tempest-CreateVolumesFromSnapshotTest-1134726136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-db28510b-3b49-44af-84c0-d6489a7979b0 tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (932f1b86-f5b5-488f-9725-a85c5291b667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e7a479f-5ef3-407c-beaa-da40cb458453', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-db28510b-3b49-44af-84c0-d6489a7979b0 tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e32be934-fbb3-44f8-941f-b9d160c138aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:03 devstack sudo[91315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144 1073741824
Feb 28 04:50:03 devstack sudo[91315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:03 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-db28510b-3b49-44af-84c0-d6489a7979b0 tempest-CreateVolumesFromImageTest-1358643878 None] Volume volume-6e7a479f-5ef3-407c-beaa-da40cb458453 (6e7a479f-5ef3-407c-beaa-da40cb458453): created successfully
Feb 28 04:50:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-db28510b-3b49-44af-84c0-d6489a7979b0 tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e32be934-fbb3-44f8-941f-b9d160c138aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:03 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-db28510b-3b49-44af-84c0-d6489a7979b0 tempest-CreateVolumesFromImageTest-1358643878 None] Flow 'volume_create_manager' (3eab6396-0cc1-4456-b25d-38897ccc18fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:03 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-db28510b-3b49-44af-84c0-d6489a7979b0 tempest-CreateVolumesFromImageTest-1358643878 None] Created volume successfully.
Feb 28 04:50:03 devstack sudo[91315]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-23442ca6-b019-4dcf-b63a-9fe241e51bfe tempest-CreateVolumesFromSnapshotTest-1134726136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144 1073741824" returned: 0 in 0.524s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:03 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-23442ca6-b019-4dcf-b63a-9fe241e51bfe tempest-CreateVolumesFromSnapshotTest-1134726136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:03 devstack sudo[91320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144
Feb 28 04:50:03 devstack sudo[91320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:04 devstack sudo[91320]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-23442ca6-b019-4dcf-b63a-9fe241e51bfe tempest-CreateVolumesFromSnapshotTest-1134726136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144" returned: 0 in 0.475s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:04 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-23442ca6-b019-4dcf-b63a-9fe241e51bfe tempest-CreateVolumesFromSnapshotTest-1134726136 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:50:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-23442ca6-b019-4dcf-b63a-9fe241e51bfe tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-6c322bad-1c75-4792-82ef-30686446f10c tempest-CreateVolumesFromImageTest-1358643878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.044s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:04 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-6c322bad-1c75-4792-82ef-30686446f10c tempest-CreateVolumesFromImageTest-1358643878 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-780267192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26ec2009-a4f7-45ac-9ab3-5f4dc1de6f07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06d9ba5789a0460c81bb8106dac050e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:01Z,use_quota=True,user_id='1fa075cbb10d4b47ab132524f8b93053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:50:04 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-6c322bad-1c75-4792-82ef-30686446f10c tempest-CreateVolumesFromImageTest-1358643878 None] Creating volume 26ec2009-a4f7-45ac-9ab3-5f4dc1de6f07 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:50:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-6c322bad-1c75-4792-82ef-30686446f10c tempest-CreateVolumesFromImageTest-1358643878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-6c322bad-1c75-4792-82ef-30686446f10c tempest-CreateVolumesFromImageTest-1358643878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:04 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-6c322bad-1c75-4792-82ef-30686446f10c tempest-CreateVolumesFromImageTest-1358643878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:04 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-6c322bad-1c75-4792-82ef-30686446f10c tempest-CreateVolumesFromImageTest-1358643878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-6c322bad-1c75-4792-82ef-30686446f10c tempest-CreateVolumesFromImageTest-1358643878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:04 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-6c322bad-1c75-4792-82ef-30686446f10c tempest-CreateVolumesFromImageTest-1358643878 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:50:04 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-6c322bad-1c75-4792-82ef-30686446f10c tempest-CreateVolumesFromImageTest-1358643878 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:50:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6c322bad-1c75-4792-82ef-30686446f10c tempest-CreateVolumesFromImageTest-1358643878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-26ec2009-a4f7-45ac-9ab3-5f4dc1de6f07 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-23442ca6-b019-4dcf-b63a-9fe241e51bfe tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211cd0e4-ff4f-4afc-9910-beb1aa8bbeac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73d57c89-7228-43e4-ae94-e3cc2e050144', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-23442ca6-b019-4dcf-b63a-9fe241e51bfe tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2607aed7-6cac-4552-85ac-685a12008bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:04 devstack sudo[91323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-26ec2009-a4f7-45ac-9ab3-5f4dc1de6f07 1073741824
Feb 28 04:50:04 devstack sudo[91323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:04 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-23442ca6-b019-4dcf-b63a-9fe241e51bfe tempest-CreateVolumesFromSnapshotTest-1134726136 None] Volume volume-73d57c89-7228-43e4-ae94-e3cc2e050144 (73d57c89-7228-43e4-ae94-e3cc2e050144): created successfully
Feb 28 04:50:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-23442ca6-b019-4dcf-b63a-9fe241e51bfe tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2607aed7-6cac-4552-85ac-685a12008bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:04 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-23442ca6-b019-4dcf-b63a-9fe241e51bfe tempest-CreateVolumesFromSnapshotTest-1134726136 None] Flow 'volume_create_manager' (cb079605-735c-4e82-a1c0-efe3a136126d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:04 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-23442ca6-b019-4dcf-b63a-9fe241e51bfe tempest-CreateVolumesFromSnapshotTest-1134726136 None] Created volume successfully.
Feb 28 04:50:04 devstack sudo[91323]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6c322bad-1c75-4792-82ef-30686446f10c tempest-CreateVolumesFromImageTest-1358643878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-26ec2009-a4f7-45ac-9ab3-5f4dc1de6f07 1073741824" returned: 0 in 0.552s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:04 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6c322bad-1c75-4792-82ef-30686446f10c tempest-CreateVolumesFromImageTest-1358643878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-26ec2009-a4f7-45ac-9ab3-5f4dc1de6f07 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:04 devstack sudo[91328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-26ec2009-a4f7-45ac-9ab3-5f4dc1de6f07
Feb 28 04:50:04 devstack sudo[91328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:05 devstack sudo[91328]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6c322bad-1c75-4792-82ef-30686446f10c tempest-CreateVolumesFromImageTest-1358643878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-26ec2009-a4f7-45ac-9ab3-5f4dc1de6f07" returned: 0 in 0.503s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:05 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-6c322bad-1c75-4792-82ef-30686446f10c tempest-CreateVolumesFromImageTest-1358643878 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:50:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-6c322bad-1c75-4792-82ef-30686446f10c tempest-CreateVolumesFromImageTest-1358643878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-cb970409-4588-44af-926d-9c5d286f0b85 tempest-CreateVolumesFromImageTest-1358643878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.865s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:05 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-cb970409-4588-44af-926d-9c5d286f0b85 tempest-CreateVolumesFromImageTest-1358643878 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-356871993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c794c051-4e71-4274-a981-62b20bf6be43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06d9ba5789a0460c81bb8106dac050e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:01Z,use_quota=True,user_id='1fa075cbb10d4b47ab132524f8b93053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:50:05 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-cb970409-4588-44af-926d-9c5d286f0b85 tempest-CreateVolumesFromImageTest-1358643878 None] Creating volume c794c051-4e71-4274-a981-62b20bf6be43 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:50:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-cb970409-4588-44af-926d-9c5d286f0b85 tempest-CreateVolumesFromImageTest-1358643878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-cb970409-4588-44af-926d-9c5d286f0b85 tempest-CreateVolumesFromImageTest-1358643878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:05 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-cb970409-4588-44af-926d-9c5d286f0b85 tempest-CreateVolumesFromImageTest-1358643878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:05 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-cb970409-4588-44af-926d-9c5d286f0b85 tempest-CreateVolumesFromImageTest-1358643878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-cb970409-4588-44af-926d-9c5d286f0b85 tempest-CreateVolumesFromImageTest-1358643878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:05 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-cb970409-4588-44af-926d-9c5d286f0b85 tempest-CreateVolumesFromImageTest-1358643878 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:50:05 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-cb970409-4588-44af-926d-9c5d286f0b85 tempest-CreateVolumesFromImageTest-1358643878 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:50:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-cb970409-4588-44af-926d-9c5d286f0b85 tempest-CreateVolumesFromImageTest-1358643878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c794c051-4e71-4274-a981-62b20bf6be43 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:05 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6c322bad-1c75-4792-82ef-30686446f10c tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (006f0ea3-e2e0-468d-9d5b-3229a2e4cdd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26ec2009-a4f7-45ac-9ab3-5f4dc1de6f07', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:05 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6c322bad-1c75-4792-82ef-30686446f10c tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d93b974-41b0-4f52-88ec-6f2b37d1d10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:05 devstack sudo[91331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c794c051-4e71-4274-a981-62b20bf6be43 1073741824
Feb 28 04:50:05 devstack sudo[91331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:05 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-6c322bad-1c75-4792-82ef-30686446f10c tempest-CreateVolumesFromImageTest-1358643878 None] Volume volume-26ec2009-a4f7-45ac-9ab3-5f4dc1de6f07 (26ec2009-a4f7-45ac-9ab3-5f4dc1de6f07): created successfully
Feb 28 04:50:05 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6c322bad-1c75-4792-82ef-30686446f10c tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d93b974-41b0-4f52-88ec-6f2b37d1d10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:05 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-6c322bad-1c75-4792-82ef-30686446f10c tempest-CreateVolumesFromImageTest-1358643878 None] Flow 'volume_create_manager' (7dd6378f-1853-4b1c-ad6f-998c98774b13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a0fa7f00-52a8-48e3-b841-73c1e578e656 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:05 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-6c322bad-1c75-4792-82ef-30686446f10c tempest-CreateVolumesFromImageTest-1358643878 None] Created volume successfully.
Feb 28 04:50:05 devstack sudo[91331]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-cb970409-4588-44af-926d-9c5d286f0b85 tempest-CreateVolumesFromImageTest-1358643878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c794c051-4e71-4274-a981-62b20bf6be43 1073741824" returned: 0 in 0.593s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:05 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-cb970409-4588-44af-926d-9c5d286f0b85 tempest-CreateVolumesFromImageTest-1358643878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c794c051-4e71-4274-a981-62b20bf6be43 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:06 devstack sudo[91336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c794c051-4e71-4274-a981-62b20bf6be43
Feb 28 04:50:06 devstack sudo[91336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:06 devstack sudo[91336]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-cb970409-4588-44af-926d-9c5d286f0b85 tempest-CreateVolumesFromImageTest-1358643878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c794c051-4e71-4274-a981-62b20bf6be43" returned: 0 in 0.515s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:06 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-cb970409-4588-44af-926d-9c5d286f0b85 tempest-CreateVolumesFromImageTest-1358643878 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:50:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-cb970409-4588-44af-926d-9c5d286f0b85 tempest-CreateVolumesFromImageTest-1358643878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d3b58ea1-72dd-4eaa-9793-5f0d25ecdbdd tempest-CreateVolumesFromImageTest-1358643878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.821s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:06 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-d3b58ea1-72dd-4eaa-9793-5f0d25ecdbdd tempest-CreateVolumesFromImageTest-1358643878 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-267133105',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=693af190-844a-4b23-9c71-49014dc27099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06d9ba5789a0460c81bb8106dac050e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:02Z,use_quota=True,user_id='1fa075cbb10d4b47ab132524f8b93053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:50:06 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-d3b58ea1-72dd-4eaa-9793-5f0d25ecdbdd tempest-CreateVolumesFromImageTest-1358643878 None] Creating volume 693af190-844a-4b23-9c71-49014dc27099 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:50:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d3b58ea1-72dd-4eaa-9793-5f0d25ecdbdd tempest-CreateVolumesFromImageTest-1358643878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d3b58ea1-72dd-4eaa-9793-5f0d25ecdbdd tempest-CreateVolumesFromImageTest-1358643878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:06 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-d3b58ea1-72dd-4eaa-9793-5f0d25ecdbdd tempest-CreateVolumesFromImageTest-1358643878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:06 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-d3b58ea1-72dd-4eaa-9793-5f0d25ecdbdd tempest-CreateVolumesFromImageTest-1358643878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d3b58ea1-72dd-4eaa-9793-5f0d25ecdbdd tempest-CreateVolumesFromImageTest-1358643878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:06 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-d3b58ea1-72dd-4eaa-9793-5f0d25ecdbdd tempest-CreateVolumesFromImageTest-1358643878 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:50:06 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-d3b58ea1-72dd-4eaa-9793-5f0d25ecdbdd tempest-CreateVolumesFromImageTest-1358643878 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:50:06 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d3b58ea1-72dd-4eaa-9793-5f0d25ecdbdd tempest-CreateVolumesFromImageTest-1358643878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-693af190-844a-4b23-9c71-49014dc27099 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-cb970409-4588-44af-926d-9c5d286f0b85 tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67fc47aa-08d6-4843-b2a9-3f350cb073d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c794c051-4e71-4274-a981-62b20bf6be43', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:06 devstack sudo[91339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-693af190-844a-4b23-9c71-49014dc27099 1073741824
Feb 28 04:50:06 devstack sudo[91339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-cb970409-4588-44af-926d-9c5d286f0b85 tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e545711d-4249-4050-96b0-1dd4a295b52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:06 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-cb970409-4588-44af-926d-9c5d286f0b85 tempest-CreateVolumesFromImageTest-1358643878 None] Volume volume-c794c051-4e71-4274-a981-62b20bf6be43 (c794c051-4e71-4274-a981-62b20bf6be43): created successfully
Feb 28 04:50:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-cb970409-4588-44af-926d-9c5d286f0b85 tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e545711d-4249-4050-96b0-1dd4a295b52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:06 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-cb970409-4588-44af-926d-9c5d286f0b85 tempest-CreateVolumesFromImageTest-1358643878 None] Flow 'volume_create_manager' (befefa95-cab3-4196-9166-0b7f4ab0aa1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:06 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-cb970409-4588-44af-926d-9c5d286f0b85 tempest-CreateVolumesFromImageTest-1358643878 None] Created volume successfully.
Feb 28 04:50:07 devstack sudo[91339]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d3b58ea1-72dd-4eaa-9793-5f0d25ecdbdd tempest-CreateVolumesFromImageTest-1358643878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-693af190-844a-4b23-9c71-49014dc27099 1073741824" returned: 0 in 0.555s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d3b58ea1-72dd-4eaa-9793-5f0d25ecdbdd tempest-CreateVolumesFromImageTest-1358643878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-693af190-844a-4b23-9c71-49014dc27099 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:07 devstack sudo[91344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-693af190-844a-4b23-9c71-49014dc27099
Feb 28 04:50:07 devstack sudo[91344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:07 devstack sudo[91344]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d3b58ea1-72dd-4eaa-9793-5f0d25ecdbdd tempest-CreateVolumesFromImageTest-1358643878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-693af190-844a-4b23-9c71-49014dc27099" returned: 0 in 0.457s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:07 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-d3b58ea1-72dd-4eaa-9793-5f0d25ecdbdd tempest-CreateVolumesFromImageTest-1358643878 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:50:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d3b58ea1-72dd-4eaa-9793-5f0d25ecdbdd tempest-CreateVolumesFromImageTest-1358643878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-63489b15-fe49-4fc1-bce5-9fd1e8ecc95c tempest-CreateVolumesFromImageTest-1358643878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.671s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:07 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-63489b15-fe49-4fc1-bce5-9fd1e8ecc95c tempest-CreateVolumesFromImageTest-1358643878 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-743143646',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6baa732-d75f-4ef6-836f-ee2140bc92ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06d9ba5789a0460c81bb8106dac050e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:02Z,use_quota=True,user_id='1fa075cbb10d4b47ab132524f8b93053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:50:07 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-63489b15-fe49-4fc1-bce5-9fd1e8ecc95c tempest-CreateVolumesFromImageTest-1358643878 None] Creating volume a6baa732-d75f-4ef6-836f-ee2140bc92ce {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:50:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-63489b15-fe49-4fc1-bce5-9fd1e8ecc95c tempest-CreateVolumesFromImageTest-1358643878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-63489b15-fe49-4fc1-bce5-9fd1e8ecc95c tempest-CreateVolumesFromImageTest-1358643878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:07 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-63489b15-fe49-4fc1-bce5-9fd1e8ecc95c tempest-CreateVolumesFromImageTest-1358643878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:07 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-63489b15-fe49-4fc1-bce5-9fd1e8ecc95c tempest-CreateVolumesFromImageTest-1358643878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-63489b15-fe49-4fc1-bce5-9fd1e8ecc95c tempest-CreateVolumesFromImageTest-1358643878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:07 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-63489b15-fe49-4fc1-bce5-9fd1e8ecc95c tempest-CreateVolumesFromImageTest-1358643878 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:50:07 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-63489b15-fe49-4fc1-bce5-9fd1e8ecc95c tempest-CreateVolumesFromImageTest-1358643878 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:50:07 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-63489b15-fe49-4fc1-bce5-9fd1e8ecc95c tempest-CreateVolumesFromImageTest-1358643878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a6baa732-d75f-4ef6-836f-ee2140bc92ce 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:07 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d3b58ea1-72dd-4eaa-9793-5f0d25ecdbdd tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5da1716-9afe-4001-9b67-0ca50673a469) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-693af190-844a-4b23-9c71-49014dc27099', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:07 devstack sudo[91347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a6baa732-d75f-4ef6-836f-ee2140bc92ce 1073741824
Feb 28 04:50:07 devstack sudo[91347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:07 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d3b58ea1-72dd-4eaa-9793-5f0d25ecdbdd tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f8642f0-decf-4f0b-ba34-ca86aff7c7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:07 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-d3b58ea1-72dd-4eaa-9793-5f0d25ecdbdd tempest-CreateVolumesFromImageTest-1358643878 None] Volume volume-693af190-844a-4b23-9c71-49014dc27099 (693af190-844a-4b23-9c71-49014dc27099): created successfully
Feb 28 04:50:07 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d3b58ea1-72dd-4eaa-9793-5f0d25ecdbdd tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f8642f0-decf-4f0b-ba34-ca86aff7c7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:07 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d3b58ea1-72dd-4eaa-9793-5f0d25ecdbdd tempest-CreateVolumesFromImageTest-1358643878 None] Flow 'volume_create_manager' (0149a3e7-d93c-4662-8b46-d7e675c4e274) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:07 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-d3b58ea1-72dd-4eaa-9793-5f0d25ecdbdd tempest-CreateVolumesFromImageTest-1358643878 None] Created volume successfully.
Feb 28 04:50:08 devstack sudo[91347]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-63489b15-fe49-4fc1-bce5-9fd1e8ecc95c tempest-CreateVolumesFromImageTest-1358643878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a6baa732-d75f-4ef6-836f-ee2140bc92ce 1073741824" returned: 0 in 0.531s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-63489b15-fe49-4fc1-bce5-9fd1e8ecc95c tempest-CreateVolumesFromImageTest-1358643878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a6baa732-d75f-4ef6-836f-ee2140bc92ce {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:08 devstack sudo[91352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a6baa732-d75f-4ef6-836f-ee2140bc92ce
Feb 28 04:50:08 devstack sudo[91352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:08 devstack sudo[91352]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-63489b15-fe49-4fc1-bce5-9fd1e8ecc95c tempest-CreateVolumesFromImageTest-1358643878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a6baa732-d75f-4ef6-836f-ee2140bc92ce" returned: 0 in 0.464s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:08 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-63489b15-fe49-4fc1-bce5-9fd1e8ecc95c tempest-CreateVolumesFromImageTest-1358643878 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:50:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-63489b15-fe49-4fc1-bce5-9fd1e8ecc95c tempest-CreateVolumesFromImageTest-1358643878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-917199dd-d27c-4c4d-b799-0fb4ac8a033a tempest-VolumeDependencyTests-581964465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.465s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:08 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-63489b15-fe49-4fc1-bce5-9fd1e8ecc95c tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb72d3aa-09c7-413d-a695-8bf957e9078c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6baa732-d75f-4ef6-836f-ee2140bc92ce', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:08 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-63489b15-fe49-4fc1-bce5-9fd1e8ecc95c tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13755c2b-9662-4ffd-86ff-7d6a5a83debb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:08 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-917199dd-d27c-4c4d-b799-0fb4ac8a033a tempest-VolumeDependencyTests-581964465 None] Creating offline snapshot de85a062-d971-4aec-9d30-a9c300995e87 of volume 8cc32111-3c25-4f27-ad03-fb7fa45952b2 {{(pid=84248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 04:50:08 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-63489b15-fe49-4fc1-bce5-9fd1e8ecc95c tempest-CreateVolumesFromImageTest-1358643878 None] Volume volume-a6baa732-d75f-4ef6-836f-ee2140bc92ce (a6baa732-d75f-4ef6-836f-ee2140bc92ce): created successfully
Feb 28 04:50:08 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-63489b15-fe49-4fc1-bce5-9fd1e8ecc95c tempest-CreateVolumesFromImageTest-1358643878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13755c2b-9662-4ffd-86ff-7d6a5a83debb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:08 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-63489b15-fe49-4fc1-bce5-9fd1e8ecc95c tempest-CreateVolumesFromImageTest-1358643878 None] Flow 'volume_create_manager' (8b964d75-23fa-4f8a-85b5-1f745bf06fbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:08 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e602355-9e9e-404a-9661-2020b857739e]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:08 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-917199dd-d27c-4c4d-b799-0fb4ac8a033a tempest-VolumeDependencyTests-581964465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:08 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-63489b15-fe49-4fc1-bce5-9fd1e8ecc95c tempest-CreateVolumesFromImageTest-1358643878 None] Created volume successfully.
Feb 28 04:50:08 devstack sudo[91355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2
Feb 28 04:50:08 devstack sudo[91355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:09 devstack sudo[91355]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:09 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-917199dd-d27c-4c4d-b799-0fb4ac8a033a tempest-VolumeDependencyTests-581964465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2" returned: 0 in 0.479s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:09 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-917199dd-d27c-4c4d-b799-0fb4ac8a033a tempest-VolumeDependencyTests-581964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2.de85a062-d971-4aec-9d30-a9c300995e87 1G {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:09 devstack sudo[91360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2.de85a062-d971-4aec-9d30-a9c300995e87 1G
Feb 28 04:50:09 devstack sudo[91360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:09 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-403f86b1-1564-40a6-b1d8-d4f0fa849793 tempest-CreateVolumesFromImageTest-1358643878 None] Acquiring lock "cinder-a6baa732-d75f-4ef6-836f-ee2140bc92ce-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:09 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-403f86b1-1564-40a6-b1d8-d4f0fa849793 tempest-CreateVolumesFromImageTest-1358643878 None] Lock "cinder-a6baa732-d75f-4ef6-836f-ee2140bc92ce-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:09 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-403f86b1-1564-40a6-b1d8-d4f0fa849793 tempest-CreateVolumesFromImageTest-1358643878 None] Acquiring lock "cinder-quobyte-a6baa732-d75f-4ef6-836f-ee2140bc92ce" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:09 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-403f86b1-1564-40a6-b1d8-d4f0fa849793 tempest-CreateVolumesFromImageTest-1358643878 None] Lock "cinder-quobyte-a6baa732-d75f-4ef6-836f-ee2140bc92ce" acquired by "delete_volume" :: waited 0.012s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:09 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ff7a04-0428-4816-b953-cf0bd8020b03]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:09 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-403f86b1-1564-40a6-b1d8-d4f0fa849793 tempest-CreateVolumesFromImageTest-1358643878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a6baa732-d75f-4ef6-836f-ee2140bc92ce {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:09 devstack sudo[91360]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:09 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-917199dd-d27c-4c4d-b799-0fb4ac8a033a tempest-VolumeDependencyTests-581964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2.de85a062-d971-4aec-9d30-a9c300995e87 1G" returned: 0 in 0.592s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:09 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-917199dd-d27c-4c4d-b799-0fb4ac8a033a tempest-VolumeDependencyTests-581964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2.de85a062-d971-4aec-9d30-a9c300995e87 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:09 devstack sudo[91365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a6baa732-d75f-4ef6-836f-ee2140bc92ce
Feb 28 04:50:09 devstack sudo[91365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:09 devstack sudo[91366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2.de85a062-d971-4aec-9d30-a9c300995e87
Feb 28 04:50:09 devstack sudo[91366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:10 devstack sudo[91366]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-917199dd-d27c-4c4d-b799-0fb4ac8a033a tempest-VolumeDependencyTests-581964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2.de85a062-d971-4aec-9d30-a9c300995e87" returned: 0 in 0.424s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:10 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-917199dd-d27c-4c4d-b799-0fb4ac8a033a tempest-VolumeDependencyTests-581964465 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2.de85a062-d971-4aec-9d30-a9c300995e87 is being set with open permissions: ugo+rw
Feb 28 04:50:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-917199dd-d27c-4c4d-b799-0fb4ac8a033a tempest-VolumeDependencyTests-581964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2.de85a062-d971-4aec-9d30-a9c300995e87 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:10 devstack sudo[91365]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-403f86b1-1564-40a6-b1d8-d4f0fa849793 tempest-CreateVolumesFromImageTest-1358643878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a6baa732-d75f-4ef6-836f-ee2140bc92ce" returned: 0 in 0.507s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-403f86b1-1564-40a6-b1d8-d4f0fa849793 tempest-CreateVolumesFromImageTest-1358643878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a6baa732-d75f-4ef6-836f-ee2140bc92ce {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:10 devstack sudo[91376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2.de85a062-d971-4aec-9d30-a9c300995e87
Feb 28 04:50:10 devstack sudo[91376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:10 devstack sudo[91377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a6baa732-d75f-4ef6-836f-ee2140bc92ce
Feb 28 04:50:10 devstack sudo[91377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:10 devstack sudo[91377]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-403f86b1-1564-40a6-b1d8-d4f0fa849793 tempest-CreateVolumesFromImageTest-1358643878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a6baa732-d75f-4ef6-836f-ee2140bc92ce" returned: 0 in 0.447s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:10 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-403f86b1-1564-40a6-b1d8-d4f0fa849793 tempest-CreateVolumesFromImageTest-1358643878 None] Lock "cinder-quobyte-a6baa732-d75f-4ef6-836f-ee2140bc92ce" released by "delete_volume" :: held 0.985s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:10 devstack sudo[91376]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-917199dd-d27c-4c4d-b799-0fb4ac8a033a tempest-VolumeDependencyTests-581964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2.de85a062-d971-4aec-9d30-a9c300995e87" returned: 0 in 0.483s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-917199dd-d27c-4c4d-b799-0fb4ac8a033a tempest-VolumeDependencyTests-581964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:10 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-403f86b1-1564-40a6-b1d8-d4f0fa849793 tempest-CreateVolumesFromImageTest-1358643878 None] Created reservations ['373d7048-16d7-4a69-a275-3dfd71927ffe', 'b7414f08-c1f6-4c73-97d0-26dcc9a19b78', '6cc0c118-67f6-4331-8813-29f6a4ed74d9', '2bd67454-4907-42c5-adc0-d6e707e3b63d'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:50:10 devstack sudo[91382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2.info
Feb 28 04:50:10 devstack sudo[91382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-403f86b1-1564-40a6-b1d8-d4f0fa849793 tempest-CreateVolumesFromImageTest-1358643878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-403f86b1-1564-40a6-b1d8-d4f0fa849793 tempest-CreateVolumesFromImageTest-1358643878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:10 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-403f86b1-1564-40a6-b1d8-d4f0fa849793 tempest-CreateVolumesFromImageTest-1358643878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:10 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-403f86b1-1564-40a6-b1d8-d4f0fa849793 tempest-CreateVolumesFromImageTest-1358643878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-403f86b1-1564-40a6-b1d8-d4f0fa849793 tempest-CreateVolumesFromImageTest-1358643878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:10 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-403f86b1-1564-40a6-b1d8-d4f0fa849793 tempest-CreateVolumesFromImageTest-1358643878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:10 devstack sudo[91384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:50:10 devstack sudo[91384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:11 devstack sudo[91382]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-917199dd-d27c-4c4d-b799-0fb4ac8a033a tempest-VolumeDependencyTests-581964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2.info" returned: 0 in 0.490s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:11 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-917199dd-d27c-4c4d-b799-0fb4ac8a033a tempest-VolumeDependencyTests-581964465 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2.info is being set with open permissions: ugo+rw
Feb 28 04:50:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-917199dd-d27c-4c4d-b799-0fb4ac8a033a tempest-VolumeDependencyTests-581964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:11 devstack sudo[91388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2.info
Feb 28 04:50:11 devstack sudo[91388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:11 devstack sudo[91384]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-403f86b1-1564-40a6-b1d8-d4f0fa849793 tempest-CreateVolumesFromImageTest-1358643878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.461s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:11 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-403f86b1-1564-40a6-b1d8-d4f0fa849793 tempest-CreateVolumesFromImageTest-1358643878 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:50:11 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-403f86b1-1564-40a6-b1d8-d4f0fa849793 tempest-CreateVolumesFromImageTest-1358643878 None] Deleted volume successfully.
Feb 28 04:50:11 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-403f86b1-1564-40a6-b1d8-d4f0fa849793 tempest-CreateVolumesFromImageTest-1358643878 None] Lock "cinder-a6baa732-d75f-4ef6-836f-ee2140bc92ce-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:11 devstack sudo[91388]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-917199dd-d27c-4c4d-b799-0fb4ac8a033a tempest-VolumeDependencyTests-581964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2.info" returned: 0 in 0.436s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-917199dd-d27c-4c4d-b799-0fb4ac8a033a tempest-VolumeDependencyTests-581964465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.995s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a0fa7f00-52a8-48e3-b841-73c1e578e656 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.141s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:11 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-a0fa7f00-52a8-48e3-b841-73c1e578e656 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Creating offline snapshot d400cc92-d8d8-4e96-a072-daae94887187 of volume 73d57c89-7228-43e4-ae94-e3cc2e050144 {{(pid=84248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 04:50:11 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[8348a83c-dacd-4b5c-b4b3-a8d1493e0050]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a0fa7f00-52a8-48e3-b841-73c1e578e656 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:11 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-917199dd-d27c-4c4d-b799-0fb4ac8a033a tempest-VolumeDependencyTests-581964465 None] Create snapshot completed successfully
Feb 28 04:50:11 devstack sudo[91391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144
Feb 28 04:50:11 devstack sudo[91391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:11 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-b1717a72-b8f3-4236-b274-40f7e73560de tempest-CreateVolumesFromImageTest-1358643878 None] Acquiring lock "cinder-693af190-844a-4b23-9c71-49014dc27099-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:11 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-b1717a72-b8f3-4236-b274-40f7e73560de tempest-CreateVolumesFromImageTest-1358643878 None] Lock "cinder-693af190-844a-4b23-9c71-49014dc27099-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:11 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-b1717a72-b8f3-4236-b274-40f7e73560de tempest-CreateVolumesFromImageTest-1358643878 None] Acquiring lock "cinder-quobyte-693af190-844a-4b23-9c71-49014dc27099" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:11 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-b1717a72-b8f3-4236-b274-40f7e73560de tempest-CreateVolumesFromImageTest-1358643878 None] Lock "cinder-quobyte-693af190-844a-4b23-9c71-49014dc27099" acquired by "delete_volume" :: waited 0.014s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:11 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b90fc7a-f9ef-4163-8b6b-c351c7940d16]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:11 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b1717a72-b8f3-4236-b274-40f7e73560de tempest-CreateVolumesFromImageTest-1358643878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-693af190-844a-4b23-9c71-49014dc27099 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:12 devstack sudo[91393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-693af190-844a-4b23-9c71-49014dc27099
Feb 28 04:50:12 devstack sudo[91393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:12 devstack sudo[91391]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a0fa7f00-52a8-48e3-b841-73c1e578e656 tempest-CreateVolumesFromSnapshotTest-1134726136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144" returned: 0 in 0.750s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a0fa7f00-52a8-48e3-b841-73c1e578e656 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144.d400cc92-d8d8-4e96-a072-daae94887187 1G {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:12 devstack sudo[91398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144.d400cc92-d8d8-4e96-a072-daae94887187 1G
Feb 28 04:50:12 devstack sudo[91398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:12 devstack sudo[91393]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b1717a72-b8f3-4236-b274-40f7e73560de tempest-CreateVolumesFromImageTest-1358643878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-693af190-844a-4b23-9c71-49014dc27099" returned: 0 in 0.681s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b1717a72-b8f3-4236-b274-40f7e73560de tempest-CreateVolumesFromImageTest-1358643878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-693af190-844a-4b23-9c71-49014dc27099 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:12 devstack sudo[91403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-693af190-844a-4b23-9c71-49014dc27099
Feb 28 04:50:12 devstack sudo[91403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:12 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:50:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Flow 'volume_create_manager' (4fe0d441-326f-428c-83b7-58d21a6b5603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2773b1a8-7da8-4bbb-8272-ccc740649dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2773b1a8-7da8-4bbb-8272-ccc740649dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-595811824',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f990e796-0484-4b6e-a2d3-f95b6181eb43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a88a855c6524bad869cffeef21a285b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=de85a062-d971-4aec-9d30-a9c300995e87,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:13Z,use_quota=True,user_id='37cf0981063b41cd9dda2cbc314a761f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd0c4309-6539-4aea-b514-5997abdab03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd0c4309-6539-4aea-b514-5997abdab03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b85dbed-9d7c-422b-862c-b08d582ef63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b85dbed-9d7c-422b-862c-b08d582ef63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f990e796-0484-4b6e-a2d3-f95b6181eb43', 'volume_name': 'volume-f990e796-0484-4b6e-a2d3-f95b6181eb43', 'volume_size': 1, 'snapshot_id': 'de85a062-d971-4aec-9d30-a9c300995e87'}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f41aead-3e63-4755-b0b5-e7662ce96b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f41aead-3e63-4755-b0b5-e7662ce96b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (219f39a0-31af-4f3b-9d43-e12e50a49e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:12 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Volume f990e796-0484-4b6e-a2d3-f95b6181eb43: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f990e796-0484-4b6e-a2d3-f95b6181eb43', 'volume_size': 1, 'snapshot_id': 'de85a062-d971-4aec-9d30-a9c300995e87'}
Feb 28 04:50:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:12 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-34f61984-2075-4bad-be78-6631b1a19eff tempest-SnapshotDependencyTests-1591423573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:50:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-34f61984-2075-4bad-be78-6631b1a19eff tempest-SnapshotDependencyTests-1591423573 None] Flow 'volume_create_manager' (56d99e29-9d00-4b54-bdef-0867f059df6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:12 devstack sudo[91398]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:12 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-34f61984-2075-4bad-be78-6631b1a19eff tempest-SnapshotDependencyTests-1591423573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f978ca00-8b9a-42e7-bee8-9b77737bf635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a0fa7f00-52a8-48e3-b841-73c1e578e656 tempest-CreateVolumesFromSnapshotTest-1134726136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144.d400cc92-d8d8-4e96-a072-daae94887187 1G" returned: 0 in 0.622s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:12 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a0fa7f00-52a8-48e3-b841-73c1e578e656 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73d57c89-7228-43e4-ae94-e3cc2e050144 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144.d400cc92-d8d8-4e96-a072-daae94887187 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:13 devstack sudo[91409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73d57c89-7228-43e4-ae94-e3cc2e050144 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144.d400cc92-d8d8-4e96-a072-daae94887187
Feb 28 04:50:13 devstack sudo[91409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:13 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-34f61984-2075-4bad-be78-6631b1a19eff tempest-SnapshotDependencyTests-1591423573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f978ca00-8b9a-42e7-bee8-9b77737bf635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-65003645',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5e67871-e782-40e6-8711-08bc89eb2cd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='862ac588ffbd4bf694a9b4854ead8e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:13Z,use_quota=True,user_id='582a5471f36044bfba4cbb4618fc8951',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:13 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-34f61984-2075-4bad-be78-6631b1a19eff tempest-SnapshotDependencyTests-1591423573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a786d8d-c29e-4b83-9dfb-5f98098557ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:13 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-34f61984-2075-4bad-be78-6631b1a19eff tempest-SnapshotDependencyTests-1591423573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a786d8d-c29e-4b83-9dfb-5f98098557ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:13 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-34f61984-2075-4bad-be78-6631b1a19eff tempest-SnapshotDependencyTests-1591423573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd071147-296b-4b02-bda0-dc80c49c2d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:13 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-34f61984-2075-4bad-be78-6631b1a19eff tempest-SnapshotDependencyTests-1591423573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd071147-296b-4b02-bda0-dc80c49c2d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5e67871-e782-40e6-8711-08bc89eb2cd1', 'volume_name': 'volume-a5e67871-e782-40e6-8711-08bc89eb2cd1', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:13 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-34f61984-2075-4bad-be78-6631b1a19eff tempest-SnapshotDependencyTests-1591423573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d28979c7-4956-423c-a81d-71a7c4f57ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:13 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-34f61984-2075-4bad-be78-6631b1a19eff tempest-SnapshotDependencyTests-1591423573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d28979c7-4956-423c-a81d-71a7c4f57ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:13 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-34f61984-2075-4bad-be78-6631b1a19eff tempest-SnapshotDependencyTests-1591423573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d5292bc-2597-45ca-ac63-ae250506ceac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:13 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-34f61984-2075-4bad-be78-6631b1a19eff tempest-SnapshotDependencyTests-1591423573 None] Volume a5e67871-e782-40e6-8711-08bc89eb2cd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5e67871-e782-40e6-8711-08bc89eb2cd1', 'volume_size': 1}
Feb 28 04:50:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-34f61984-2075-4bad-be78-6631b1a19eff tempest-SnapshotDependencyTests-1591423573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:13 devstack sudo[91403]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b1717a72-b8f3-4236-b274-40f7e73560de tempest-CreateVolumesFromImageTest-1358643878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-693af190-844a-4b23-9c71-49014dc27099" returned: 0 in 0.492s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:13 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-b1717a72-b8f3-4236-b274-40f7e73560de tempest-CreateVolumesFromImageTest-1358643878 None] Lock "cinder-quobyte-693af190-844a-4b23-9c71-49014dc27099" released by "delete_volume" :: held 1.197s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:13 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-b1717a72-b8f3-4236-b274-40f7e73560de tempest-CreateVolumesFromImageTest-1358643878 None] Created reservations ['95a6033e-cfd0-40f5-bbed-e8f0b1cc165b', '8d75170d-a8df-4724-b8d5-d7b079676e71', 'e8ee323c-61b5-4cb9-9fef-002091bd7ad2', '60380d2f-03e6-4110-b99c-c700ed432888'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:50:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b1717a72-b8f3-4236-b274-40f7e73560de tempest-CreateVolumesFromImageTest-1358643878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b1717a72-b8f3-4236-b274-40f7e73560de tempest-CreateVolumesFromImageTest-1358643878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:13 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-b1717a72-b8f3-4236-b274-40f7e73560de tempest-CreateVolumesFromImageTest-1358643878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:13 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-b1717a72-b8f3-4236-b274-40f7e73560de tempest-CreateVolumesFromImageTest-1358643878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b1717a72-b8f3-4236-b274-40f7e73560de tempest-CreateVolumesFromImageTest-1358643878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b1717a72-b8f3-4236-b274-40f7e73560de tempest-CreateVolumesFromImageTest-1358643878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:13 devstack sudo[91411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:50:13 devstack sudo[91411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:13 devstack sudo[91409]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a0fa7f00-52a8-48e3-b841-73c1e578e656 tempest-CreateVolumesFromSnapshotTest-1134726136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73d57c89-7228-43e4-ae94-e3cc2e050144 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144.d400cc92-d8d8-4e96-a072-daae94887187" returned: 0 in 0.432s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:13 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-a0fa7f00-52a8-48e3-b841-73c1e578e656 tempest-CreateVolumesFromSnapshotTest-1134726136 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144.d400cc92-d8d8-4e96-a072-daae94887187 is being set with open permissions: ugo+rw
Feb 28 04:50:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a0fa7f00-52a8-48e3-b841-73c1e578e656 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144.d400cc92-d8d8-4e96-a072-daae94887187 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:13 devstack sudo[91416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144.d400cc92-d8d8-4e96-a072-daae94887187
Feb 28 04:50:13 devstack sudo[91416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:13 devstack sudo[91411]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b1717a72-b8f3-4236-b274-40f7e73560de tempest-CreateVolumesFromImageTest-1358643878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.407s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:13 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-b1717a72-b8f3-4236-b274-40f7e73560de tempest-CreateVolumesFromImageTest-1358643878 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:50:13 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-b1717a72-b8f3-4236-b274-40f7e73560de tempest-CreateVolumesFromImageTest-1358643878 None] Deleted volume successfully.
Feb 28 04:50:13 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-b1717a72-b8f3-4236-b274-40f7e73560de tempest-CreateVolumesFromImageTest-1358643878 None] Lock "cinder-693af190-844a-4b23-9c71-49014dc27099-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:13 devstack sudo[91416]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a0fa7f00-52a8-48e3-b841-73c1e578e656 tempest-CreateVolumesFromSnapshotTest-1134726136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144.d400cc92-d8d8-4e96-a072-daae94887187" returned: 0 in 0.421s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:13 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a0fa7f00-52a8-48e3-b841-73c1e578e656 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:13 devstack sudo[91420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144.info
Feb 28 04:50:13 devstack sudo[91420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:13 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6c47d158-c95e-4582-adef-fd6700290f45 tempest-CreateVolumesFromImageTest-1358643878 None] Acquiring lock "cinder-c794c051-4e71-4274-a981-62b20bf6be43-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:13 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6c47d158-c95e-4582-adef-fd6700290f45 tempest-CreateVolumesFromImageTest-1358643878 None] Lock "cinder-c794c051-4e71-4274-a981-62b20bf6be43-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:14 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6c47d158-c95e-4582-adef-fd6700290f45 tempest-CreateVolumesFromImageTest-1358643878 None] Acquiring lock "cinder-quobyte-c794c051-4e71-4274-a981-62b20bf6be43" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:14 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6c47d158-c95e-4582-adef-fd6700290f45 tempest-CreateVolumesFromImageTest-1358643878 None] Lock "cinder-quobyte-c794c051-4e71-4274-a981-62b20bf6be43" acquired by "delete_volume" :: waited 0.006s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:14 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a5ec07-ead1-4878-9956-6ac4eae517cc]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6c47d158-c95e-4582-adef-fd6700290f45 tempest-CreateVolumesFromImageTest-1358643878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c794c051-4e71-4274-a981-62b20bf6be43 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:14 devstack sudo[91422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c794c051-4e71-4274-a981-62b20bf6be43
Feb 28 04:50:14 devstack sudo[91422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:14 devstack sudo[91420]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a0fa7f00-52a8-48e3-b841-73c1e578e656 tempest-CreateVolumesFromSnapshotTest-1134726136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144.info" returned: 0 in 0.426s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:14 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-a0fa7f00-52a8-48e3-b841-73c1e578e656 tempest-CreateVolumesFromSnapshotTest-1134726136 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144.info is being set with open permissions: ugo+rw
Feb 28 04:50:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a0fa7f00-52a8-48e3-b841-73c1e578e656 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:14 devstack sudo[91425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144.info
Feb 28 04:50:14 devstack sudo[91425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:14 devstack sudo[91422]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6c47d158-c95e-4582-adef-fd6700290f45 tempest-CreateVolumesFromImageTest-1358643878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c794c051-4e71-4274-a981-62b20bf6be43" returned: 0 in 0.460s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6c47d158-c95e-4582-adef-fd6700290f45 tempest-CreateVolumesFromImageTest-1358643878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c794c051-4e71-4274-a981-62b20bf6be43 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:14 devstack sudo[91430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c794c051-4e71-4274-a981-62b20bf6be43
Feb 28 04:50:14 devstack sudo[91430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:14 devstack sudo[91425]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a0fa7f00-52a8-48e3-b841-73c1e578e656 tempest-CreateVolumesFromSnapshotTest-1134726136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144.info" returned: 0 in 0.387s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a0fa7f00-52a8-48e3-b841-73c1e578e656 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.096s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.791s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:14 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Acquiring lock "cinder-quobyte-de85a062-d971-4aec-9d30-a9c300995e87-f990e796-0484-4b6e-a2d3-f95b6181eb43" by "_create_volume_from_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:14 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-a0fa7f00-52a8-48e3-b841-73c1e578e656 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Create snapshot completed successfully
Feb 28 04:50:14 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Lock "cinder-quobyte-de85a062-d971-4aec-9d30-a9c300995e87-f990e796-0484-4b6e-a2d3-f95b6181eb43" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:14 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Creating volume f990e796-0484-4b6e-a2d3-f95b6181eb43 from snapshot de85a062-d971-4aec-9d30-a9c300995e87 {{(pid=84248) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Feb 28 04:50:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:14 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:14 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:14 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:50:14 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Acquiring lock "cinder-quobyte-f990e796-0484-4b6e-a2d3-f95b6181eb43" by "_copy_volume_from_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:14 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Lock "cinder-quobyte-f990e796-0484-4b6e-a2d3-f95b6181eb43" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:14 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] snapshot: de85a062-d971-4aec-9d30-a9c300995e87, volume: f990e796-0484-4b6e-a2d3-f95b6181eb43,  {{(pid=84248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 28 04:50:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:14 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:14 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:14 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf7ccc7-9666-4ec5-a45a-a7e9b36d4c35]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2.de85a062-d971-4aec-9d30-a9c300995e87 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:14 devstack sudo[91433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2.de85a062-d971-4aec-9d30-a9c300995e87
Feb 28 04:50:14 devstack sudo[91433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:14 devstack sudo[91430]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:14 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6c47d158-c95e-4582-adef-fd6700290f45 tempest-CreateVolumesFromImageTest-1358643878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c794c051-4e71-4274-a981-62b20bf6be43" returned: 0 in 0.429s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:14 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6c47d158-c95e-4582-adef-fd6700290f45 tempest-CreateVolumesFromImageTest-1358643878 None] Lock "cinder-quobyte-c794c051-4e71-4274-a981-62b20bf6be43" released by "delete_volume" :: held 0.919s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:14 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-6c47d158-c95e-4582-adef-fd6700290f45 tempest-CreateVolumesFromImageTest-1358643878 None] Created reservations ['65000b66-0b4f-486c-a44c-37fe51846c40', 'ca6d14ca-ae4c-4722-9703-472f3389fb78', 'bd121712-acd8-48ff-b402-86efbf3306c7', '4bed8aef-51e3-4a4f-acff-f24cd418e514'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:50:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-6c47d158-c95e-4582-adef-fd6700290f45 tempest-CreateVolumesFromImageTest-1358643878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-6c47d158-c95e-4582-adef-fd6700290f45 tempest-CreateVolumesFromImageTest-1358643878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:15 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-6c47d158-c95e-4582-adef-fd6700290f45 tempest-CreateVolumesFromImageTest-1358643878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:15 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-6c47d158-c95e-4582-adef-fd6700290f45 tempest-CreateVolumesFromImageTest-1358643878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-6c47d158-c95e-4582-adef-fd6700290f45 tempest-CreateVolumesFromImageTest-1358643878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6c47d158-c95e-4582-adef-fd6700290f45 tempest-CreateVolumesFromImageTest-1358643878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:15 devstack sudo[91436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:50:15 devstack sudo[91436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:15 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-61d53864-37a5-497d-8414-827fc4bc3f14 tempest-CreateVolumesFromImageTest-1358643878 None] Acquiring lock "cinder-26ec2009-a4f7-45ac-9ab3-5f4dc1de6f07-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:15 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-61d53864-37a5-497d-8414-827fc4bc3f14 tempest-CreateVolumesFromImageTest-1358643878 None] Lock "cinder-26ec2009-a4f7-45ac-9ab3-5f4dc1de6f07-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:15 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-61d53864-37a5-497d-8414-827fc4bc3f14 tempest-CreateVolumesFromImageTest-1358643878 None] Acquiring lock "cinder-quobyte-26ec2009-a4f7-45ac-9ab3-5f4dc1de6f07" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:15 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-61d53864-37a5-497d-8414-827fc4bc3f14 tempest-CreateVolumesFromImageTest-1358643878 None] Lock "cinder-quobyte-26ec2009-a4f7-45ac-9ab3-5f4dc1de6f07" acquired by "delete_volume" :: waited 0.007s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:15 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8abc93f-ea40-4ac4-bf27-2f9163761288]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-61d53864-37a5-497d-8414-827fc4bc3f14 tempest-CreateVolumesFromImageTest-1358643878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-26ec2009-a4f7-45ac-9ab3-5f4dc1de6f07 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:15 devstack sudo[91440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-26ec2009-a4f7-45ac-9ab3-5f4dc1de6f07
Feb 28 04:50:15 devstack sudo[91440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:15 devstack sudo[91433]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2.de85a062-d971-4aec-9d30-a9c300995e87" returned: 0 in 0.490s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:15 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:50:15 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] will copy from snapshot at /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2 {{(pid=84248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 28 04:50:15 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Creating direct copy from snapshot {{(pid=84248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 28 04:50:15 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9afbf71-101b-4e09-98c7-e01f7ed2fe07]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:15 devstack sudo[91443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2
Feb 28 04:50:15 devstack sudo[91443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:15 devstack sudo[91436]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6c47d158-c95e-4582-adef-fd6700290f45 tempest-CreateVolumesFromImageTest-1358643878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.456s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:15 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-6c47d158-c95e-4582-adef-fd6700290f45 tempest-CreateVolumesFromImageTest-1358643878 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:50:15 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-6c47d158-c95e-4582-adef-fd6700290f45 tempest-CreateVolumesFromImageTest-1358643878 None] Deleted volume successfully.
Feb 28 04:50:15 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6c47d158-c95e-4582-adef-fd6700290f45 tempest-CreateVolumesFromImageTest-1358643878 None] Lock "cinder-c794c051-4e71-4274-a981-62b20bf6be43-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:15 devstack sudo[91440]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-61d53864-37a5-497d-8414-827fc4bc3f14 tempest-CreateVolumesFromImageTest-1358643878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-26ec2009-a4f7-45ac-9ab3-5f4dc1de6f07" returned: 0 in 0.504s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-61d53864-37a5-497d-8414-827fc4bc3f14 tempest-CreateVolumesFromImageTest-1358643878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-26ec2009-a4f7-45ac-9ab3-5f4dc1de6f07 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:15 devstack sudo[91452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-26ec2009-a4f7-45ac-9ab3-5f4dc1de6f07
Feb 28 04:50:15 devstack sudo[91452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:15 devstack sudo[91443]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2" returned: 0 in 0.490s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:15 devstack cinder-volume[84248]: DEBUG cinder.utils [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Path /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f990e796-0484-4b6e-a2d3-f95b6181eb43 not found in is_blk_device check {{(pid=84248) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 28 04:50:15 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f990e796-0484-4b6e-a2d3-f95b6181eb43 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:15 devstack sudo[91454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f990e796-0484-4b6e-a2d3-f95b6181eb43
Feb 28 04:50:15 devstack sudo[91454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:16 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdb61997-e4c8-467b-9bfb-ab4a4d14e7dc tempest-CreateVolumesFromSnapshotTest-1134726136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:50:16 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-cdb61997-e4c8-467b-9bfb-ab4a4d14e7dc tempest-CreateVolumesFromSnapshotTest-1134726136 None] Flow 'volume_create_manager' (249de2b5-33b6-4839-96ce-7a5691efdd22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:16 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-cdb61997-e4c8-467b-9bfb-ab4a4d14e7dc tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12705bd6-40cb-466e-9aba-5198050d7b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:16 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-cdb61997-e4c8-467b-9bfb-ab4a4d14e7dc tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12705bd6-40cb-466e-9aba-5198050d7b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-367126245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91ae528f-f4f4-424d-8910-3363cb1e2ff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7196b4e67ebe4b2299bda8f580d0f770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:16Z,use_quota=True,user_id='eaa4bc1ff9d04c4bac02fa29ede04085',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:16 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-cdb61997-e4c8-467b-9bfb-ab4a4d14e7dc tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f99ce559-e57d-4fa2-9a7f-ff173cfaa5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:16 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-cdb61997-e4c8-467b-9bfb-ab4a4d14e7dc tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f99ce559-e57d-4fa2-9a7f-ff173cfaa5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:16 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-cdb61997-e4c8-467b-9bfb-ab4a4d14e7dc tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a3e68c8-9e37-43d9-8e85-1ed0749f34d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:16 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-cdb61997-e4c8-467b-9bfb-ab4a4d14e7dc tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a3e68c8-9e37-43d9-8e85-1ed0749f34d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91ae528f-f4f4-424d-8910-3363cb1e2ff8', 'volume_name': 'volume-91ae528f-f4f4-424d-8910-3363cb1e2ff8', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:16 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-cdb61997-e4c8-467b-9bfb-ab4a4d14e7dc tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bd27e3b-51a8-40d8-9bd3-ad9e521963eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:16 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-cdb61997-e4c8-467b-9bfb-ab4a4d14e7dc tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bd27e3b-51a8-40d8-9bd3-ad9e521963eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:16 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-cdb61997-e4c8-467b-9bfb-ab4a4d14e7dc tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e501bc71-2f67-4987-9e41-3206d936dba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:16 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-cdb61997-e4c8-467b-9bfb-ab4a4d14e7dc tempest-CreateVolumesFromSnapshotTest-1134726136 None] Volume 91ae528f-f4f4-424d-8910-3363cb1e2ff8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91ae528f-f4f4-424d-8910-3363cb1e2ff8', 'volume_size': 1}
Feb 28 04:50:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-cdb61997-e4c8-467b-9bfb-ab4a4d14e7dc tempest-CreateVolumesFromSnapshotTest-1134726136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:16 devstack sudo[91452]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-61d53864-37a5-497d-8414-827fc4bc3f14 tempest-CreateVolumesFromImageTest-1358643878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-26ec2009-a4f7-45ac-9ab3-5f4dc1de6f07" returned: 0 in 0.498s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:16 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-61d53864-37a5-497d-8414-827fc4bc3f14 tempest-CreateVolumesFromImageTest-1358643878 None] Lock "cinder-quobyte-26ec2009-a4f7-45ac-9ab3-5f4dc1de6f07" released by "delete_volume" :: held 1.036s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:16 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-61d53864-37a5-497d-8414-827fc4bc3f14 tempest-CreateVolumesFromImageTest-1358643878 None] Created reservations ['b26216d6-18a3-48eb-ace8-c6711101857d', '7f8a1bef-fd4e-4438-b0ce-6f75e672393b', '1a0b40a4-f1b8-40d3-b0a6-5f1f0fcf368a', 'de7a4bfe-e806-4aa2-81d7-2428dccbe91f'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:50:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-61d53864-37a5-497d-8414-827fc4bc3f14 tempest-CreateVolumesFromImageTest-1358643878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-61d53864-37a5-497d-8414-827fc4bc3f14 tempest-CreateVolumesFromImageTest-1358643878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:16 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-61d53864-37a5-497d-8414-827fc4bc3f14 tempest-CreateVolumesFromImageTest-1358643878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:16 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-61d53864-37a5-497d-8414-827fc4bc3f14 tempest-CreateVolumesFromImageTest-1358643878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-61d53864-37a5-497d-8414-827fc4bc3f14 tempest-CreateVolumesFromImageTest-1358643878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-61d53864-37a5-497d-8414-827fc4bc3f14 tempest-CreateVolumesFromImageTest-1358643878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:16 devstack sudo[91461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:50:16 devstack sudo[91461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:16 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3648310-c208-43e7-91d1-cbea0be15eed tempest-CreateVolumesFromSnapshotTest-1134726136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:50:16 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a3648310-c208-43e7-91d1-cbea0be15eed tempest-CreateVolumesFromSnapshotTest-1134726136 None] Flow 'volume_create_manager' (3e29bca8-8850-49c7-808f-fcf6841060d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:16 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a3648310-c208-43e7-91d1-cbea0be15eed tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32186aa9-e8e2-48e6-aeb2-40dcedbdea92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:16 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a3648310-c208-43e7-91d1-cbea0be15eed tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32186aa9-e8e2-48e6-aeb2-40dcedbdea92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-183112356',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a8f2c1e-f639-4301-b70e-013257a81709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7196b4e67ebe4b2299bda8f580d0f770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:16Z,use_quota=True,user_id='eaa4bc1ff9d04c4bac02fa29ede04085',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:16 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a3648310-c208-43e7-91d1-cbea0be15eed tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d84c3b9-51d2-4127-a72f-b6c1eefccc2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:16 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a3648310-c208-43e7-91d1-cbea0be15eed tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d84c3b9-51d2-4127-a72f-b6c1eefccc2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:16 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a3648310-c208-43e7-91d1-cbea0be15eed tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cce18f7-60dc-405b-a2ca-674f4b17ce17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:16 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a3648310-c208-43e7-91d1-cbea0be15eed tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cce18f7-60dc-405b-a2ca-674f4b17ce17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a8f2c1e-f639-4301-b70e-013257a81709', 'volume_name': 'volume-5a8f2c1e-f639-4301-b70e-013257a81709', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:16 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a3648310-c208-43e7-91d1-cbea0be15eed tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60719d5a-de36-49d5-9ec0-2890ea6a20c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:16 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a3648310-c208-43e7-91d1-cbea0be15eed tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60719d5a-de36-49d5-9ec0-2890ea6a20c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:16 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a3648310-c208-43e7-91d1-cbea0be15eed tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f71527c6-4057-4c3d-b2d4-9dbe66702d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:16 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-a3648310-c208-43e7-91d1-cbea0be15eed tempest-CreateVolumesFromSnapshotTest-1134726136 None] Volume 5a8f2c1e-f639-4301-b70e-013257a81709: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a8f2c1e-f639-4301-b70e-013257a81709', 'volume_size': 1}
Feb 28 04:50:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a3648310-c208-43e7-91d1-cbea0be15eed tempest-CreateVolumesFromSnapshotTest-1134726136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:16 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-d52bfad3-b951-4bca-a8a3-e6c9af1c15a1 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:50:16 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d52bfad3-b951-4bca-a8a3-e6c9af1c15a1 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Flow 'volume_create_manager' (78a0bce9-2aad-46c3-a17d-bbc365974a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:16 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d52bfad3-b951-4bca-a8a3-e6c9af1c15a1 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5297675-8559-4932-a60f-df21b13767aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:16 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d52bfad3-b951-4bca-a8a3-e6c9af1c15a1 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5297675-8559-4932-a60f-df21b13767aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-587260401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50e4dbfc-d58b-4df6-bb40-83fcf8fac321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7196b4e67ebe4b2299bda8f580d0f770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:17Z,use_quota=True,user_id='eaa4bc1ff9d04c4bac02fa29ede04085',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:16 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d52bfad3-b951-4bca-a8a3-e6c9af1c15a1 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4b993d2-f2e7-4b23-ab00-b4a2da2ce55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:16 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d52bfad3-b951-4bca-a8a3-e6c9af1c15a1 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4b993d2-f2e7-4b23-ab00-b4a2da2ce55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:16 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d52bfad3-b951-4bca-a8a3-e6c9af1c15a1 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe9f2251-a392-4d53-a629-e1e11549083a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:16 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d52bfad3-b951-4bca-a8a3-e6c9af1c15a1 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe9f2251-a392-4d53-a629-e1e11549083a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50e4dbfc-d58b-4df6-bb40-83fcf8fac321', 'volume_name': 'volume-50e4dbfc-d58b-4df6-bb40-83fcf8fac321', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:16 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d52bfad3-b951-4bca-a8a3-e6c9af1c15a1 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40ec3050-61fe-4787-bf2c-4fe04705757c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:16 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d52bfad3-b951-4bca-a8a3-e6c9af1c15a1 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40ec3050-61fe-4787-bf2c-4fe04705757c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:16 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d52bfad3-b951-4bca-a8a3-e6c9af1c15a1 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (890c946c-15cf-43cf-b0ad-cf0e4d77c9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:16 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-d52bfad3-b951-4bca-a8a3-e6c9af1c15a1 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Volume 50e4dbfc-d58b-4df6-bb40-83fcf8fac321: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50e4dbfc-d58b-4df6-bb40-83fcf8fac321', 'volume_size': 1}
Feb 28 04:50:16 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d52bfad3-b951-4bca-a8a3-e6c9af1c15a1 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:17 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6b2c881-07a6-4b84-8557-5e45424212be tempest-CreateVolumesFromSnapshotTest-1134726136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:50:17 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d6b2c881-07a6-4b84-8557-5e45424212be tempest-CreateVolumesFromSnapshotTest-1134726136 None] Flow 'volume_create_manager' (d86c4185-b6bb-49ab-866b-3db0a500749f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:17 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d6b2c881-07a6-4b84-8557-5e45424212be tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a528bd30-63cb-4a29-bf50-0bccf87074aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:17 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d6b2c881-07a6-4b84-8557-5e45424212be tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a528bd30-63cb-4a29-bf50-0bccf87074aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1535779522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4584583-8750-4322-87aa-ad9d417cebf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7196b4e67ebe4b2299bda8f580d0f770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:17Z,use_quota=True,user_id='eaa4bc1ff9d04c4bac02fa29ede04085',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:17 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d6b2c881-07a6-4b84-8557-5e45424212be tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40369444-cfe0-4aaf-a7bf-778837142bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:17 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d6b2c881-07a6-4b84-8557-5e45424212be tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40369444-cfe0-4aaf-a7bf-778837142bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:17 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d6b2c881-07a6-4b84-8557-5e45424212be tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8608c91e-988f-4a17-9345-5f441d6700d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:17 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d6b2c881-07a6-4b84-8557-5e45424212be tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8608c91e-988f-4a17-9345-5f441d6700d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4584583-8750-4322-87aa-ad9d417cebf7', 'volume_name': 'volume-a4584583-8750-4322-87aa-ad9d417cebf7', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:17 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d6b2c881-07a6-4b84-8557-5e45424212be tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4e90f76-fd44-4ac8-b92b-d5753e03d842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:17 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d6b2c881-07a6-4b84-8557-5e45424212be tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4e90f76-fd44-4ac8-b92b-d5753e03d842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:17 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d6b2c881-07a6-4b84-8557-5e45424212be tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b7b43bf-3926-48ea-8ecb-b27006323603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:17 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-d6b2c881-07a6-4b84-8557-5e45424212be tempest-CreateVolumesFromSnapshotTest-1134726136 None] Volume a4584583-8750-4322-87aa-ad9d417cebf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4584583-8750-4322-87aa-ad9d417cebf7', 'volume_size': 1}
Feb 28 04:50:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d6b2c881-07a6-4b84-8557-5e45424212be tempest-CreateVolumesFromSnapshotTest-1134726136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:17 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f298cd16-271b-4cf4-b40d-8883d4e9cad4 tempest-CreateVolumesFromImageTest-1358643878 None] Acquiring lock "cinder-6e7a479f-5ef3-407c-beaa-da40cb458453-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:17 devstack sudo[91461]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-61d53864-37a5-497d-8414-827fc4bc3f14 tempest-CreateVolumesFromImageTest-1358643878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 1.512s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:17 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-61d53864-37a5-497d-8414-827fc4bc3f14 tempest-CreateVolumesFromImageTest-1358643878 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:50:17 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-61d53864-37a5-497d-8414-827fc4bc3f14 tempest-CreateVolumesFromImageTest-1358643878 None] Deleted volume successfully.
Feb 28 04:50:17 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f298cd16-271b-4cf4-b40d-8883d4e9cad4 tempest-CreateVolumesFromImageTest-1358643878 None] Lock "cinder-6e7a479f-5ef3-407c-beaa-da40cb458453-delete_volume" acquired by "delete_volume" :: waited 0.145s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:17 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-61d53864-37a5-497d-8414-827fc4bc3f14 tempest-CreateVolumesFromImageTest-1358643878 None] Lock "cinder-26ec2009-a4f7-45ac-9ab3-5f4dc1de6f07-delete_volume" released by "delete_volume" :: held 2.788s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:17 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f298cd16-271b-4cf4-b40d-8883d4e9cad4 tempest-CreateVolumesFromImageTest-1358643878 None] Acquiring lock "cinder-quobyte-6e7a479f-5ef3-407c-beaa-da40cb458453" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:17 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f298cd16-271b-4cf4-b40d-8883d4e9cad4 tempest-CreateVolumesFromImageTest-1358643878 None] Lock "cinder-quobyte-6e7a479f-5ef3-407c-beaa-da40cb458453" acquired by "delete_volume" :: waited 0.017s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:17 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4c307b-72b3-41ce-bf02-fb0d0f4dc4cf]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:17 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f298cd16-271b-4cf4-b40d-8883d4e9cad4 tempest-CreateVolumesFromImageTest-1358643878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6e7a479f-5ef3-407c-beaa-da40cb458453 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:18 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-d75a8751-12a1-48f5-867c-01033a4062cf tempest-CreateVolumesFromSnapshotTest-1134726136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:50:18 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d75a8751-12a1-48f5-867c-01033a4062cf tempest-CreateVolumesFromSnapshotTest-1134726136 None] Flow 'volume_create_manager' (02e3aad3-bb4a-44ee-a29f-566552ddc494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:18 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d75a8751-12a1-48f5-867c-01033a4062cf tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03c25506-99e7-4380-a3e8-78884eae569a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:18 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d75a8751-12a1-48f5-867c-01033a4062cf tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03c25506-99e7-4380-a3e8-78884eae569a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1298919494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e600966-331a-417d-99fa-07b90aaa1408,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7196b4e67ebe4b2299bda8f580d0f770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:18Z,use_quota=True,user_id='eaa4bc1ff9d04c4bac02fa29ede04085',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:18 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d75a8751-12a1-48f5-867c-01033a4062cf tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10d5f151-5bf8-43c5-8415-63d9e4557825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:18 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d75a8751-12a1-48f5-867c-01033a4062cf tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10d5f151-5bf8-43c5-8415-63d9e4557825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:18 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d75a8751-12a1-48f5-867c-01033a4062cf tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3e5a5a8-c65d-4ffb-9186-db32bc6e9284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:18 devstack sudo[91473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6e7a479f-5ef3-407c-beaa-da40cb458453
Feb 28 04:50:18 devstack sudo[91473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:18 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d75a8751-12a1-48f5-867c-01033a4062cf tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3e5a5a8-c65d-4ffb-9186-db32bc6e9284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e600966-331a-417d-99fa-07b90aaa1408', 'volume_name': 'volume-1e600966-331a-417d-99fa-07b90aaa1408', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:18 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d75a8751-12a1-48f5-867c-01033a4062cf tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24c6950a-46b3-4636-a58b-a6009fd04eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:18 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d75a8751-12a1-48f5-867c-01033a4062cf tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24c6950a-46b3-4636-a58b-a6009fd04eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:18 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d75a8751-12a1-48f5-867c-01033a4062cf tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3de9597a-f3b8-47e0-8a66-94c3444e86ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:18 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-d75a8751-12a1-48f5-867c-01033a4062cf tempest-CreateVolumesFromSnapshotTest-1134726136 None] Volume 1e600966-331a-417d-99fa-07b90aaa1408: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e600966-331a-417d-99fa-07b90aaa1408', 'volume_size': 1}
Feb 28 04:50:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d75a8751-12a1-48f5-867c-01033a4062cf tempest-CreateVolumesFromSnapshotTest-1134726136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:18 devstack sudo[91454]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f990e796-0484-4b6e-a2d3-f95b6181eb43" returned: 0 in 2.779s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:18 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[269079f3-afd1-4df7-ac64-3697d3644587]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:18 devstack sudo[91507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2
Feb 28 04:50:18 devstack sudo[91507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:18 devstack sudo[91473]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f298cd16-271b-4cf4-b40d-8883d4e9cad4 tempest-CreateVolumesFromImageTest-1358643878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6e7a479f-5ef3-407c-beaa-da40cb458453" returned: 0 in 0.727s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:18 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f298cd16-271b-4cf4-b40d-8883d4e9cad4 tempest-CreateVolumesFromImageTest-1358643878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6e7a479f-5ef3-407c-beaa-da40cb458453 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:18 devstack sudo[91514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6e7a479f-5ef3-407c-beaa-da40cb458453
Feb 28 04:50:18 devstack sudo[91514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:19 devstack sudo[91514]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f298cd16-271b-4cf4-b40d-8883d4e9cad4 tempest-CreateVolumesFromImageTest-1358643878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-6e7a479f-5ef3-407c-beaa-da40cb458453" returned: 0 in 0.417s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:19 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f298cd16-271b-4cf4-b40d-8883d4e9cad4 tempest-CreateVolumesFromImageTest-1358643878 None] Lock "cinder-quobyte-6e7a479f-5ef3-407c-beaa-da40cb458453" released by "delete_volume" :: held 1.182s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:19 devstack sudo[91507]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2" returned: 0 in 0.605s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:19 devstack cinder-volume[84248]: DEBUG cinder.image.image_utils [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Image conversion details: src /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2, size 1024.00 MB, duration 2.78 sec, destination /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f990e796-0484-4b6e-a2d3-f95b6181eb43 {{(pid=84248) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 28 04:50:19 devstack cinder-volume[84248]: INFO cinder.image.image_utils [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Converted 1024.00 MB image at 368.34 MB/s
Feb 28 04:50:19 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f990e796-0484-4b6e-a2d3-f95b6181eb43 is being set with open permissions: ugo+rw
Feb 28 04:50:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f990e796-0484-4b6e-a2d3-f95b6181eb43 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:19 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-f298cd16-271b-4cf4-b40d-8883d4e9cad4 tempest-CreateVolumesFromImageTest-1358643878 None] Created reservations ['59c92964-26f3-439e-a853-ff5f00555199', '3f6fd9c9-f601-4331-b308-97309430e61f', 'beee8b1f-2ed5-4305-baa8-07e37cdbe0a5', 'a455e368-1f0d-4210-85c0-34087c5df414'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:50:19 devstack sudo[91520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f990e796-0484-4b6e-a2d3-f95b6181eb43
Feb 28 04:50:19 devstack sudo[91520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-f298cd16-271b-4cf4-b40d-8883d4e9cad4 tempest-CreateVolumesFromImageTest-1358643878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-f298cd16-271b-4cf4-b40d-8883d4e9cad4 tempest-CreateVolumesFromImageTest-1358643878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:19 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-f298cd16-271b-4cf4-b40d-8883d4e9cad4 tempest-CreateVolumesFromImageTest-1358643878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:19 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-f298cd16-271b-4cf4-b40d-8883d4e9cad4 tempest-CreateVolumesFromImageTest-1358643878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-f298cd16-271b-4cf4-b40d-8883d4e9cad4 tempest-CreateVolumesFromImageTest-1358643878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f298cd16-271b-4cf4-b40d-8883d4e9cad4 tempest-CreateVolumesFromImageTest-1358643878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:19 devstack sudo[91522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:50:19 devstack sudo[91522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:19 devstack sudo[91520]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f990e796-0484-4b6e-a2d3-f95b6181eb43" returned: 0 in 0.383s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:19 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Lock "cinder-quobyte-f990e796-0484-4b6e-a2d3-f95b6181eb43" released by "_copy_volume_from_snapshot" :: held 4.805s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:19 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Lock "cinder-quobyte-de85a062-d971-4aec-9d30-a9c300995e87-f990e796-0484-4b6e-a2d3-f95b6181eb43" released by "_create_volume_from_snapshot" :: held 4.827s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.843s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-34f61984-2075-4bad-be78-6631b1a19eff tempest-SnapshotDependencyTests-1591423573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.507s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:19 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-34f61984-2075-4bad-be78-6631b1a19eff tempest-SnapshotDependencyTests-1591423573 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-65003645',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5e67871-e782-40e6-8711-08bc89eb2cd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='862ac588ffbd4bf694a9b4854ead8e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:13Z,use_quota=True,user_id='582a5471f36044bfba4cbb4618fc8951',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:50:19 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-34f61984-2075-4bad-be78-6631b1a19eff tempest-SnapshotDependencyTests-1591423573 None] Creating volume a5e67871-e782-40e6-8711-08bc89eb2cd1 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:50:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-34f61984-2075-4bad-be78-6631b1a19eff tempest-SnapshotDependencyTests-1591423573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-34f61984-2075-4bad-be78-6631b1a19eff tempest-SnapshotDependencyTests-1591423573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:19 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-34f61984-2075-4bad-be78-6631b1a19eff tempest-SnapshotDependencyTests-1591423573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:19 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-34f61984-2075-4bad-be78-6631b1a19eff tempest-SnapshotDependencyTests-1591423573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-34f61984-2075-4bad-be78-6631b1a19eff tempest-SnapshotDependencyTests-1591423573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:19 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-34f61984-2075-4bad-be78-6631b1a19eff tempest-SnapshotDependencyTests-1591423573 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:50:19 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-34f61984-2075-4bad-be78-6631b1a19eff tempest-SnapshotDependencyTests-1591423573 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:50:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-34f61984-2075-4bad-be78-6631b1a19eff tempest-SnapshotDependencyTests-1591423573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:19 devstack sudo[91532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1 1073741824
Feb 28 04:50:19 devstack sudo[91532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:19 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (219f39a0-31af-4f3b-9d43-e12e50a49e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f990e796-0484-4b6e-a2d3-f95b6181eb43', 'volume_size': 1, 'snapshot_id': 'de85a062-d971-4aec-9d30-a9c300995e87'}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:19 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b1d1856-eeab-40f2-b92c-74d9cccd559d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:19 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Volume volume-f990e796-0484-4b6e-a2d3-f95b6181eb43 (f990e796-0484-4b6e-a2d3-f95b6181eb43): created successfully
Feb 28 04:50:19 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b1d1856-eeab-40f2-b92c-74d9cccd559d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:19 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Flow 'volume_create_manager' (4fe0d441-326f-428c-83b7-58d21a6b5603) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:19 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-82746054-870c-4737-914f-c37e575d32c6 tempest-VolumeDependencyTests-581964465 None] Created volume successfully.
Feb 28 04:50:19 devstack sudo[91522]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:19 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f298cd16-271b-4cf4-b40d-8883d4e9cad4 tempest-CreateVolumesFromImageTest-1358643878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.426s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:19 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-f298cd16-271b-4cf4-b40d-8883d4e9cad4 tempest-CreateVolumesFromImageTest-1358643878 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:50:19 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-f298cd16-271b-4cf4-b40d-8883d4e9cad4 tempest-CreateVolumesFromImageTest-1358643878 None] Deleted volume successfully.
Feb 28 04:50:19 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f298cd16-271b-4cf4-b40d-8883d4e9cad4 tempest-CreateVolumesFromImageTest-1358643878 None] Lock "cinder-6e7a479f-5ef3-407c-beaa-da40cb458453-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:20 devstack sudo[91532]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-34f61984-2075-4bad-be78-6631b1a19eff tempest-SnapshotDependencyTests-1591423573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1 1073741824" returned: 0 in 0.507s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-34f61984-2075-4bad-be78-6631b1a19eff tempest-SnapshotDependencyTests-1591423573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:20 devstack sudo[91538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1
Feb 28 04:50:20 devstack sudo[91538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:20 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-eaf75d79-cb08-48dc-b031-edca32c7d9ef tempest-VolumeDependencyTests-581964465 None] Acquiring lock "cinder-de85a062-d971-4aec-9d30-a9c300995e87-delete_snapshot" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:20 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-eaf75d79-cb08-48dc-b031-edca32c7d9ef tempest-VolumeDependencyTests-581964465 None] Lock "cinder-de85a062-d971-4aec-9d30-a9c300995e87-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:20 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-eaf75d79-cb08-48dc-b031-edca32c7d9ef tempest-VolumeDependencyTests-581964465 None] Acquiring lock "cinder-quobyte-8cc32111-3c25-4f27-ad03-fb7fa45952b2" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:20 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-eaf75d79-cb08-48dc-b031-edca32c7d9ef tempest-VolumeDependencyTests-581964465 None] Lock "cinder-quobyte-8cc32111-3c25-4f27-ad03-fb7fa45952b2" acquired by "delete_snapshot" :: waited 0.012s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:20 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-eaf75d79-cb08-48dc-b031-edca32c7d9ef tempest-VolumeDependencyTests-581964465 None] Acquiring lock "cinder-quobyte-de85a062-d971-4aec-9d30-a9c300995e87" by "_delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:20 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-eaf75d79-cb08-48dc-b031-edca32c7d9ef tempest-VolumeDependencyTests-581964465 None] Lock "cinder-quobyte-de85a062-d971-4aec-9d30-a9c300995e87" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:20 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-eaf75d79-cb08-48dc-b031-edca32c7d9ef tempest-VolumeDependencyTests-581964465 None] Deleting offline snapshot de85a062-d971-4aec-9d30-a9c300995e87 of volume 8cc32111-3c25-4f27-ad03-fb7fa45952b2 {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 04:50:20 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-eaf75d79-cb08-48dc-b031-edca32c7d9ef tempest-VolumeDependencyTests-581964465 None] snapshot_file for this snap is: volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2.de85a062-d971-4aec-9d30-a9c300995e87 {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 04:50:20 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e426a4b-4b03-4bf0-8ada-b97e12ab6087]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-eaf75d79-cb08-48dc-b031-edca32c7d9ef tempest-VolumeDependencyTests-581964465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2.de85a062-d971-4aec-9d30-a9c300995e87 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:20 devstack sudo[91538]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-34f61984-2075-4bad-be78-6631b1a19eff tempest-SnapshotDependencyTests-1591423573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1" returned: 0 in 0.442s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:20 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-34f61984-2075-4bad-be78-6631b1a19eff tempest-SnapshotDependencyTests-1591423573 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:50:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-34f61984-2075-4bad-be78-6631b1a19eff tempest-SnapshotDependencyTests-1591423573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-cdb61997-e4c8-467b-9bfb-ab4a4d14e7dc tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.363s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:20 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-cdb61997-e4c8-467b-9bfb-ab4a4d14e7dc tempest-CreateVolumesFromSnapshotTest-1134726136 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-367126245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91ae528f-f4f4-424d-8910-3363cb1e2ff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7196b4e67ebe4b2299bda8f580d0f770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:16Z,use_quota=True,user_id='eaa4bc1ff9d04c4bac02fa29ede04085',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:50:20 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-cdb61997-e4c8-467b-9bfb-ab4a4d14e7dc tempest-CreateVolumesFromSnapshotTest-1134726136 None] Creating volume 91ae528f-f4f4-424d-8910-3363cb1e2ff8 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:50:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-cdb61997-e4c8-467b-9bfb-ab4a4d14e7dc tempest-CreateVolumesFromSnapshotTest-1134726136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-cdb61997-e4c8-467b-9bfb-ab4a4d14e7dc tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:20 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-cdb61997-e4c8-467b-9bfb-ab4a4d14e7dc tempest-CreateVolumesFromSnapshotTest-1134726136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:20 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-cdb61997-e4c8-467b-9bfb-ab4a4d14e7dc tempest-CreateVolumesFromSnapshotTest-1134726136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-cdb61997-e4c8-467b-9bfb-ab4a4d14e7dc tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:20 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-cdb61997-e4c8-467b-9bfb-ab4a4d14e7dc tempest-CreateVolumesFromSnapshotTest-1134726136 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:50:20 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-cdb61997-e4c8-467b-9bfb-ab4a4d14e7dc tempest-CreateVolumesFromSnapshotTest-1134726136 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:50:20 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-cdb61997-e4c8-467b-9bfb-ab4a4d14e7dc tempest-CreateVolumesFromSnapshotTest-1134726136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-91ae528f-f4f4-424d-8910-3363cb1e2ff8 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:20 devstack sudo[91541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2.de85a062-d971-4aec-9d30-a9c300995e87
Feb 28 04:50:20 devstack sudo[91541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:20 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-34f61984-2075-4bad-be78-6631b1a19eff tempest-SnapshotDependencyTests-1591423573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d5292bc-2597-45ca-ac63-ae250506ceac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5e67871-e782-40e6-8711-08bc89eb2cd1', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:20 devstack sudo[91542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-91ae528f-f4f4-424d-8910-3363cb1e2ff8 1073741824
Feb 28 04:50:20 devstack sudo[91542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:20 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-34f61984-2075-4bad-be78-6631b1a19eff tempest-SnapshotDependencyTests-1591423573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99ad9bc9-cdb4-4358-851b-6e97a1922551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:20 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-34f61984-2075-4bad-be78-6631b1a19eff tempest-SnapshotDependencyTests-1591423573 None] Volume volume-a5e67871-e782-40e6-8711-08bc89eb2cd1 (a5e67871-e782-40e6-8711-08bc89eb2cd1): created successfully
Feb 28 04:50:20 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-34f61984-2075-4bad-be78-6631b1a19eff tempest-SnapshotDependencyTests-1591423573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99ad9bc9-cdb4-4358-851b-6e97a1922551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:20 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-34f61984-2075-4bad-be78-6631b1a19eff tempest-SnapshotDependencyTests-1591423573 None] Flow 'volume_create_manager' (56d99e29-9d00-4b54-bdef-0867f059df6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:20 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-34f61984-2075-4bad-be78-6631b1a19eff tempest-SnapshotDependencyTests-1591423573 None] Created volume successfully.
Feb 28 04:50:21 devstack sudo[91541]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-eaf75d79-cb08-48dc-b031-edca32c7d9ef tempest-VolumeDependencyTests-581964465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2.de85a062-d971-4aec-9d30-a9c300995e87" returned: 0 in 0.582s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:21 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-eaf75d79-cb08-48dc-b031-edca32c7d9ef tempest-VolumeDependencyTests-581964465 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:50:21 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9de84e5-b188-41ec-b8e7-b19102d9da18]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-eaf75d79-cb08-48dc-b031-edca32c7d9ef tempest-VolumeDependencyTests-581964465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:21 devstack sudo[91542]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-cdb61997-e4c8-467b-9bfb-ab4a4d14e7dc tempest-CreateVolumesFromSnapshotTest-1134726136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-91ae528f-f4f4-424d-8910-3363cb1e2ff8 1073741824" returned: 0 in 0.536s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-cdb61997-e4c8-467b-9bfb-ab4a4d14e7dc tempest-CreateVolumesFromSnapshotTest-1134726136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-91ae528f-f4f4-424d-8910-3363cb1e2ff8 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:21 devstack sudo[91552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-91ae528f-f4f4-424d-8910-3363cb1e2ff8
Feb 28 04:50:21 devstack sudo[91552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:21 devstack sudo[91551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2
Feb 28 04:50:21 devstack sudo[91551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:21 devstack sudo[91552]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-cdb61997-e4c8-467b-9bfb-ab4a4d14e7dc tempest-CreateVolumesFromSnapshotTest-1134726136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-91ae528f-f4f4-424d-8910-3363cb1e2ff8" returned: 0 in 0.487s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:21 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-cdb61997-e4c8-467b-9bfb-ab4a4d14e7dc tempest-CreateVolumesFromSnapshotTest-1134726136 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:50:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-cdb61997-e4c8-467b-9bfb-ab4a4d14e7dc tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:21 devstack sudo[91551]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a3648310-c208-43e7-91d1-cbea0be15eed tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.974s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:21 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-a3648310-c208-43e7-91d1-cbea0be15eed tempest-CreateVolumesFromSnapshotTest-1134726136 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-183112356',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a8f2c1e-f639-4301-b70e-013257a81709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7196b4e67ebe4b2299bda8f580d0f770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:16Z,use_quota=True,user_id='eaa4bc1ff9d04c4bac02fa29ede04085',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:50:21 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-a3648310-c208-43e7-91d1-cbea0be15eed tempest-CreateVolumesFromSnapshotTest-1134726136 None] Creating volume 5a8f2c1e-f639-4301-b70e-013257a81709 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:50:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a3648310-c208-43e7-91d1-cbea0be15eed tempest-CreateVolumesFromSnapshotTest-1134726136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a3648310-c208-43e7-91d1-cbea0be15eed tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:21 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-a3648310-c208-43e7-91d1-cbea0be15eed tempest-CreateVolumesFromSnapshotTest-1134726136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:21 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-a3648310-c208-43e7-91d1-cbea0be15eed tempest-CreateVolumesFromSnapshotTest-1134726136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a3648310-c208-43e7-91d1-cbea0be15eed tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:21 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-a3648310-c208-43e7-91d1-cbea0be15eed tempest-CreateVolumesFromSnapshotTest-1134726136 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:50:21 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-a3648310-c208-43e7-91d1-cbea0be15eed tempest-CreateVolumesFromSnapshotTest-1134726136 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:50:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a3648310-c208-43e7-91d1-cbea0be15eed tempest-CreateVolumesFromSnapshotTest-1134726136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-5a8f2c1e-f639-4301-b70e-013257a81709 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:21 devstack sudo[91559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-5a8f2c1e-f639-4301-b70e-013257a81709 1073741824
Feb 28 04:50:21 devstack sudo[91559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-eaf75d79-cb08-48dc-b031-edca32c7d9ef tempest-VolumeDependencyTests-581964465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2" returned: 0 in 0.583s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-eaf75d79-cb08-48dc-b031-edca32c7d9ef tempest-VolumeDependencyTests-581964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2.de85a062-d971-4aec-9d30-a9c300995e87 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:21 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-cdb61997-e4c8-467b-9bfb-ab4a4d14e7dc tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e501bc71-2f67-4987-9e41-3206d936dba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91ae528f-f4f4-424d-8910-3363cb1e2ff8', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:21 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-cdb61997-e4c8-467b-9bfb-ab4a4d14e7dc tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (762cf492-fb25-4cfc-b186-0223ac6bec6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:21 devstack sudo[91561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2.de85a062-d971-4aec-9d30-a9c300995e87
Feb 28 04:50:21 devstack sudo[91561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:21 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-cdb61997-e4c8-467b-9bfb-ab4a4d14e7dc tempest-CreateVolumesFromSnapshotTest-1134726136 None] Volume volume-91ae528f-f4f4-424d-8910-3363cb1e2ff8 (91ae528f-f4f4-424d-8910-3363cb1e2ff8): created successfully
Feb 28 04:50:21 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-cdb61997-e4c8-467b-9bfb-ab4a4d14e7dc tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (762cf492-fb25-4cfc-b186-0223ac6bec6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:21 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-cdb61997-e4c8-467b-9bfb-ab4a4d14e7dc tempest-CreateVolumesFromSnapshotTest-1134726136 None] Flow 'volume_create_manager' (249de2b5-33b6-4839-96ce-7a5691efdd22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:21 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-b42b40ab-13d6-41a8-bb44-06c0184af9bd tempest-CinderUnicodeTest-1234426951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:50:21 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b42b40ab-13d6-41a8-bb44-06c0184af9bd tempest-CinderUnicodeTest-1234426951 None] Flow 'volume_create_manager' (ec90909c-d8a6-4e01-b691-e2a15d537ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:21 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b42b40ab-13d6-41a8-bb44-06c0184af9bd tempest-CinderUnicodeTest-1234426951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a236da41-0977-44f8-ab47-a5d58304c00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:21 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-cdb61997-e4c8-467b-9bfb-ab4a4d14e7dc tempest-CreateVolumesFromSnapshotTest-1134726136 None] Created volume successfully.
Feb 28 04:50:21 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b42b40ab-13d6-41a8-bb44-06c0184af9bd tempest-CinderUnicodeTest-1234426951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a236da41-0977-44f8-ab47-a5d58304c00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9530667f-3750-4db5-a0df-202de6ba1cca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7e7b747ffcb40f4ae79cb2fa4814188',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:22Z,use_quota=True,user_id='a5d7a4047abe4bc094cd348e3c3efb67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:21 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b42b40ab-13d6-41a8-bb44-06c0184af9bd tempest-CinderUnicodeTest-1234426951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (924a0b6c-eab9-4bbf-922d-f60d94de2fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:21 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b42b40ab-13d6-41a8-bb44-06c0184af9bd tempest-CinderUnicodeTest-1234426951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (924a0b6c-eab9-4bbf-922d-f60d94de2fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:21 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b42b40ab-13d6-41a8-bb44-06c0184af9bd tempest-CinderUnicodeTest-1234426951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e31e2c1b-7e90-4ec4-a2cb-e5514fa00123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:21 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b42b40ab-13d6-41a8-bb44-06c0184af9bd tempest-CinderUnicodeTest-1234426951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e31e2c1b-7e90-4ec4-a2cb-e5514fa00123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9530667f-3750-4db5-a0df-202de6ba1cca', 'volume_name': 'volume-9530667f-3750-4db5-a0df-202de6ba1cca', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:21 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b42b40ab-13d6-41a8-bb44-06c0184af9bd tempest-CinderUnicodeTest-1234426951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (192f77df-c2bd-433b-94ad-66545937de0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:21 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b42b40ab-13d6-41a8-bb44-06c0184af9bd tempest-CinderUnicodeTest-1234426951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (192f77df-c2bd-433b-94ad-66545937de0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:21 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b42b40ab-13d6-41a8-bb44-06c0184af9bd tempest-CinderUnicodeTest-1234426951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01d7b707-7587-4b40-8a6d-d4c1a7830f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:21 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-b42b40ab-13d6-41a8-bb44-06c0184af9bd tempest-CinderUnicodeTest-1234426951 None] Volume 9530667f-3750-4db5-a0df-202de6ba1cca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9530667f-3750-4db5-a0df-202de6ba1cca', 'volume_size': 1}
Feb 28 04:50:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b42b40ab-13d6-41a8-bb44-06c0184af9bd tempest-CinderUnicodeTest-1234426951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:21 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-466891d7-0b4d-4dd0-b14d-9ad5d79dd20d tempest-SnapshotDependencyTests-1591423573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:22 devstack sudo[91561]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:22 devstack sudo[91559]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-eaf75d79-cb08-48dc-b031-edca32c7d9ef tempest-VolumeDependencyTests-581964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2.de85a062-d971-4aec-9d30-a9c300995e87" returned: 0 in 0.480s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-eaf75d79-cb08-48dc-b031-edca32c7d9ef tempest-VolumeDependencyTests-581964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2.de85a062-d971-4aec-9d30-a9c300995e87 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a3648310-c208-43e7-91d1-cbea0be15eed tempest-CreateVolumesFromSnapshotTest-1134726136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-5a8f2c1e-f639-4301-b70e-013257a81709 1073741824" returned: 0 in 0.514s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:22 devstack sudo[91569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2.de85a062-d971-4aec-9d30-a9c300995e87
Feb 28 04:50:22 devstack sudo[91569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a3648310-c208-43e7-91d1-cbea0be15eed tempest-CreateVolumesFromSnapshotTest-1134726136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-5a8f2c1e-f639-4301-b70e-013257a81709 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:22 devstack sudo[91571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-5a8f2c1e-f639-4301-b70e-013257a81709
Feb 28 04:50:22 devstack sudo[91571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:22 devstack sudo[91569]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-eaf75d79-cb08-48dc-b031-edca32c7d9ef tempest-VolumeDependencyTests-581964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2.de85a062-d971-4aec-9d30-a9c300995e87" returned: 0 in 0.411s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:22 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-eaf75d79-cb08-48dc-b031-edca32c7d9ef tempest-VolumeDependencyTests-581964465 None] Lock "cinder-quobyte-de85a062-d971-4aec-9d30-a9c300995e87" released by "_delete_snapshot" :: held 2.114s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:22 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-eaf75d79-cb08-48dc-b031-edca32c7d9ef tempest-VolumeDependencyTests-581964465 None] Lock "cinder-quobyte-8cc32111-3c25-4f27-ad03-fb7fa45952b2" released by "delete_snapshot" :: held 2.126s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:22 devstack sudo[91571]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-a3648310-c208-43e7-91d1-cbea0be15eed tempest-CreateVolumesFromSnapshotTest-1134726136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-5a8f2c1e-f639-4301-b70e-013257a81709" returned: 0 in 0.435s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:22 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-a3648310-c208-43e7-91d1-cbea0be15eed tempest-CreateVolumesFromSnapshotTest-1134726136 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:50:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-a3648310-c208-43e7-91d1-cbea0be15eed tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d52bfad3-b951-4bca-a8a3-e6c9af1c15a1 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.758s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:22 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-d52bfad3-b951-4bca-a8a3-e6c9af1c15a1 tempest-CreateVolumesFromSnapshotTest-1134726136 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-587260401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50e4dbfc-d58b-4df6-bb40-83fcf8fac321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7196b4e67ebe4b2299bda8f580d0f770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:17Z,use_quota=True,user_id='eaa4bc1ff9d04c4bac02fa29ede04085',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:50:22 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-d52bfad3-b951-4bca-a8a3-e6c9af1c15a1 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Creating volume 50e4dbfc-d58b-4df6-bb40-83fcf8fac321 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:50:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d52bfad3-b951-4bca-a8a3-e6c9af1c15a1 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d52bfad3-b951-4bca-a8a3-e6c9af1c15a1 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:22 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-d52bfad3-b951-4bca-a8a3-e6c9af1c15a1 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:22 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-d52bfad3-b951-4bca-a8a3-e6c9af1c15a1 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d52bfad3-b951-4bca-a8a3-e6c9af1c15a1 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:22 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-d52bfad3-b951-4bca-a8a3-e6c9af1c15a1 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:50:22 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-d52bfad3-b951-4bca-a8a3-e6c9af1c15a1 tempest-CreateVolumesFromSnapshotTest-1134726136 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:50:22 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d52bfad3-b951-4bca-a8a3-e6c9af1c15a1 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-50e4dbfc-d58b-4df6-bb40-83fcf8fac321 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:22 devstack sudo[91575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-50e4dbfc-d58b-4df6-bb40-83fcf8fac321 1073741824
Feb 28 04:50:22 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a3648310-c208-43e7-91d1-cbea0be15eed tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f71527c6-4057-4c3d-b2d4-9dbe66702d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a8f2c1e-f639-4301-b70e-013257a81709', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:22 devstack sudo[91575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:22 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a3648310-c208-43e7-91d1-cbea0be15eed tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af508c37-a2d5-400b-89b3-1986f415fdee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:22 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-a3648310-c208-43e7-91d1-cbea0be15eed tempest-CreateVolumesFromSnapshotTest-1134726136 None] Volume volume-5a8f2c1e-f639-4301-b70e-013257a81709 (5a8f2c1e-f639-4301-b70e-013257a81709): created successfully
Feb 28 04:50:22 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a3648310-c208-43e7-91d1-cbea0be15eed tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af508c37-a2d5-400b-89b3-1986f415fdee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:22 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-a3648310-c208-43e7-91d1-cbea0be15eed tempest-CreateVolumesFromSnapshotTest-1134726136 None] Flow 'volume_create_manager' (3e29bca8-8850-49c7-808f-fcf6841060d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:22 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-a3648310-c208-43e7-91d1-cbea0be15eed tempest-CreateVolumesFromSnapshotTest-1134726136 None] Created volume successfully.
Feb 28 04:50:22 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-eaf75d79-cb08-48dc-b031-edca32c7d9ef tempest-VolumeDependencyTests-581964465 None] Created reservations ['581f8b13-e98f-497b-a27f-6ab2bcd36515', '8878d3db-82ee-4874-8ff6-33b27a302de7', 'b3a09b9d-2ee4-4b74-af20-592a877e9c49', 'db77ec10-57d2-48f6-987c-e7bdbb4bc333'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:50:22 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-eaf75d79-cb08-48dc-b031-edca32c7d9ef tempest-VolumeDependencyTests-581964465 None] Delete snapshot completed successfully.
Feb 28 04:50:22 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-eaf75d79-cb08-48dc-b031-edca32c7d9ef tempest-VolumeDependencyTests-581964465 None] Lock "cinder-de85a062-d971-4aec-9d30-a9c300995e87-delete_snapshot" released by "delete_snapshot" :: held 2.271s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:23 devstack sudo[91575]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d52bfad3-b951-4bca-a8a3-e6c9af1c15a1 tempest-CreateVolumesFromSnapshotTest-1134726136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-50e4dbfc-d58b-4df6-bb40-83fcf8fac321 1073741824" returned: 0 in 0.479s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d52bfad3-b951-4bca-a8a3-e6c9af1c15a1 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-50e4dbfc-d58b-4df6-bb40-83fcf8fac321 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:23 devstack sudo[91580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-50e4dbfc-d58b-4df6-bb40-83fcf8fac321
Feb 28 04:50:23 devstack sudo[91580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:23 devstack sudo[91580]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d52bfad3-b951-4bca-a8a3-e6c9af1c15a1 tempest-CreateVolumesFromSnapshotTest-1134726136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-50e4dbfc-d58b-4df6-bb40-83fcf8fac321" returned: 0 in 0.405s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:23 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-d52bfad3-b951-4bca-a8a3-e6c9af1c15a1 tempest-CreateVolumesFromSnapshotTest-1134726136 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:50:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d52bfad3-b951-4bca-a8a3-e6c9af1c15a1 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d6b2c881-07a6-4b84-8557-5e45424212be tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.760s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:23 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-d6b2c881-07a6-4b84-8557-5e45424212be tempest-CreateVolumesFromSnapshotTest-1134726136 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1535779522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4584583-8750-4322-87aa-ad9d417cebf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7196b4e67ebe4b2299bda8f580d0f770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:17Z,use_quota=True,user_id='eaa4bc1ff9d04c4bac02fa29ede04085',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:50:23 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-d6b2c881-07a6-4b84-8557-5e45424212be tempest-CreateVolumesFromSnapshotTest-1134726136 None] Creating volume a4584583-8750-4322-87aa-ad9d417cebf7 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:50:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d6b2c881-07a6-4b84-8557-5e45424212be tempest-CreateVolumesFromSnapshotTest-1134726136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d6b2c881-07a6-4b84-8557-5e45424212be tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:23 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-d6b2c881-07a6-4b84-8557-5e45424212be tempest-CreateVolumesFromSnapshotTest-1134726136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:23 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-d6b2c881-07a6-4b84-8557-5e45424212be tempest-CreateVolumesFromSnapshotTest-1134726136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d6b2c881-07a6-4b84-8557-5e45424212be tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:23 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-d6b2c881-07a6-4b84-8557-5e45424212be tempest-CreateVolumesFromSnapshotTest-1134726136 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:50:23 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-d6b2c881-07a6-4b84-8557-5e45424212be tempest-CreateVolumesFromSnapshotTest-1134726136 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:50:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d6b2c881-07a6-4b84-8557-5e45424212be tempest-CreateVolumesFromSnapshotTest-1134726136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a4584583-8750-4322-87aa-ad9d417cebf7 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:23 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d52bfad3-b951-4bca-a8a3-e6c9af1c15a1 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (890c946c-15cf-43cf-b0ad-cf0e4d77c9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50e4dbfc-d58b-4df6-bb40-83fcf8fac321', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:23 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d52bfad3-b951-4bca-a8a3-e6c9af1c15a1 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10116846-f8ae-45d1-a5bf-c06e2de4eb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:23 devstack sudo[91583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a4584583-8750-4322-87aa-ad9d417cebf7 1073741824
Feb 28 04:50:23 devstack sudo[91583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:23 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-d52bfad3-b951-4bca-a8a3-e6c9af1c15a1 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Volume volume-50e4dbfc-d58b-4df6-bb40-83fcf8fac321 (50e4dbfc-d58b-4df6-bb40-83fcf8fac321): created successfully
Feb 28 04:50:23 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d52bfad3-b951-4bca-a8a3-e6c9af1c15a1 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10116846-f8ae-45d1-a5bf-c06e2de4eb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:23 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d52bfad3-b951-4bca-a8a3-e6c9af1c15a1 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Flow 'volume_create_manager' (78a0bce9-2aad-46c3-a17d-bbc365974a0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:23 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-d52bfad3-b951-4bca-a8a3-e6c9af1c15a1 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Created volume successfully.
Feb 28 04:50:23 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-5a3c5ec3-70d3-4ddf-a46e-132627e42a2d tempest-VolumeDependencyTests-581964465 None] Acquiring lock "cinder-8cc32111-3c25-4f27-ad03-fb7fa45952b2-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:23 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-5a3c5ec3-70d3-4ddf-a46e-132627e42a2d tempest-VolumeDependencyTests-581964465 None] Lock "cinder-8cc32111-3c25-4f27-ad03-fb7fa45952b2-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:23 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-5a3c5ec3-70d3-4ddf-a46e-132627e42a2d tempest-VolumeDependencyTests-581964465 None] Acquiring lock "cinder-quobyte-8cc32111-3c25-4f27-ad03-fb7fa45952b2" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:23 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-5a3c5ec3-70d3-4ddf-a46e-132627e42a2d tempest-VolumeDependencyTests-581964465 None] Lock "cinder-quobyte-8cc32111-3c25-4f27-ad03-fb7fa45952b2" acquired by "delete_volume" :: waited 0.011s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:23 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[94763342-0201-45cd-bdc0-98636a235974]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:23 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5a3c5ec3-70d3-4ddf-a46e-132627e42a2d tempest-VolumeDependencyTests-581964465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:23 devstack sudo[91585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2
Feb 28 04:50:23 devstack sudo[91585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:24 devstack sudo[91583]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d6b2c881-07a6-4b84-8557-5e45424212be tempest-CreateVolumesFromSnapshotTest-1134726136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a4584583-8750-4322-87aa-ad9d417cebf7 1073741824" returned: 0 in 0.525s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d6b2c881-07a6-4b84-8557-5e45424212be tempest-CreateVolumesFromSnapshotTest-1134726136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a4584583-8750-4322-87aa-ad9d417cebf7 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:24 devstack sudo[91590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a4584583-8750-4322-87aa-ad9d417cebf7
Feb 28 04:50:24 devstack sudo[91590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:24 devstack sudo[91585]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5a3c5ec3-70d3-4ddf-a46e-132627e42a2d tempest-VolumeDependencyTests-581964465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2" returned: 0 in 0.496s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5a3c5ec3-70d3-4ddf-a46e-132627e42a2d tempest-VolumeDependencyTests-581964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:24 devstack sudo[91595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2
Feb 28 04:50:24 devstack sudo[91595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:24 devstack sudo[91590]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d6b2c881-07a6-4b84-8557-5e45424212be tempest-CreateVolumesFromSnapshotTest-1134726136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a4584583-8750-4322-87aa-ad9d417cebf7" returned: 0 in 0.393s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:24 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-d6b2c881-07a6-4b84-8557-5e45424212be tempest-CreateVolumesFromSnapshotTest-1134726136 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:50:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d6b2c881-07a6-4b84-8557-5e45424212be tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d75a8751-12a1-48f5-867c-01033a4062cf tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.314s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:24 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-d75a8751-12a1-48f5-867c-01033a4062cf tempest-CreateVolumesFromSnapshotTest-1134726136 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1298919494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e600966-331a-417d-99fa-07b90aaa1408,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7196b4e67ebe4b2299bda8f580d0f770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:18Z,use_quota=True,user_id='eaa4bc1ff9d04c4bac02fa29ede04085',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:50:24 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-d75a8751-12a1-48f5-867c-01033a4062cf tempest-CreateVolumesFromSnapshotTest-1134726136 None] Creating volume 1e600966-331a-417d-99fa-07b90aaa1408 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:50:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d75a8751-12a1-48f5-867c-01033a4062cf tempest-CreateVolumesFromSnapshotTest-1134726136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d75a8751-12a1-48f5-867c-01033a4062cf tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:24 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-d75a8751-12a1-48f5-867c-01033a4062cf tempest-CreateVolumesFromSnapshotTest-1134726136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:24 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-d75a8751-12a1-48f5-867c-01033a4062cf tempest-CreateVolumesFromSnapshotTest-1134726136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d75a8751-12a1-48f5-867c-01033a4062cf tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:24 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-d75a8751-12a1-48f5-867c-01033a4062cf tempest-CreateVolumesFromSnapshotTest-1134726136 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:50:24 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-d75a8751-12a1-48f5-867c-01033a4062cf tempest-CreateVolumesFromSnapshotTest-1134726136 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:50:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d75a8751-12a1-48f5-867c-01033a4062cf tempest-CreateVolumesFromSnapshotTest-1134726136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1e600966-331a-417d-99fa-07b90aaa1408 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:24 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d6b2c881-07a6-4b84-8557-5e45424212be tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b7b43bf-3926-48ea-8ecb-b27006323603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4584583-8750-4322-87aa-ad9d417cebf7', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:24 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d6b2c881-07a6-4b84-8557-5e45424212be tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f2b6faa-7187-4675-85d7-35cf385b8143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:24 devstack sudo[91598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1e600966-331a-417d-99fa-07b90aaa1408 1073741824
Feb 28 04:50:24 devstack sudo[91598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:24 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-d6b2c881-07a6-4b84-8557-5e45424212be tempest-CreateVolumesFromSnapshotTest-1134726136 None] Volume volume-a4584583-8750-4322-87aa-ad9d417cebf7 (a4584583-8750-4322-87aa-ad9d417cebf7): created successfully
Feb 28 04:50:24 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d6b2c881-07a6-4b84-8557-5e45424212be tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f2b6faa-7187-4675-85d7-35cf385b8143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:24 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d6b2c881-07a6-4b84-8557-5e45424212be tempest-CreateVolumesFromSnapshotTest-1134726136 None] Flow 'volume_create_manager' (d86c4185-b6bb-49ab-866b-3db0a500749f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:24 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-d6b2c881-07a6-4b84-8557-5e45424212be tempest-CreateVolumesFromSnapshotTest-1134726136 None] Created volume successfully.
Feb 28 04:50:24 devstack sudo[91595]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5a3c5ec3-70d3-4ddf-a46e-132627e42a2d tempest-VolumeDependencyTests-581964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-8cc32111-3c25-4f27-ad03-fb7fa45952b2" returned: 0 in 0.423s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:24 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-5a3c5ec3-70d3-4ddf-a46e-132627e42a2d tempest-VolumeDependencyTests-581964465 None] Lock "cinder-quobyte-8cc32111-3c25-4f27-ad03-fb7fa45952b2" released by "delete_volume" :: held 0.951s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:24 devstack cinder-volume[84248]: DEBUG oslo_service.periodic_task [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84248) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 28 04:50:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:24 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:24 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:24 devstack sudo[91601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:50:24 devstack sudo[91601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:24 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-5a3c5ec3-70d3-4ddf-a46e-132627e42a2d tempest-VolumeDependencyTests-581964465 None] Created reservations ['e5ceba0f-3244-4294-8cf7-f57d7208dea9', '7b432649-c76d-4146-97c6-efb8e70e6d3c', 'c1b40cf3-22b6-471a-bc7f-57edc1753b13', '3f3e7fac-0647-42a3-9086-a37e0726dea5'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:50:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5a3c5ec3-70d3-4ddf-a46e-132627e42a2d tempest-VolumeDependencyTests-581964465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5a3c5ec3-70d3-4ddf-a46e-132627e42a2d tempest-VolumeDependencyTests-581964465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:24 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-5a3c5ec3-70d3-4ddf-a46e-132627e42a2d tempest-VolumeDependencyTests-581964465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:24 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-5a3c5ec3-70d3-4ddf-a46e-132627e42a2d tempest-VolumeDependencyTests-581964465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5a3c5ec3-70d3-4ddf-a46e-132627e42a2d tempest-VolumeDependencyTests-581964465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:24 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5a3c5ec3-70d3-4ddf-a46e-132627e42a2d tempest-VolumeDependencyTests-581964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:24 devstack sudo[91603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:50:24 devstack sudo[91603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:24 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-f01ea130-1e08-4e72-8138-1b47974671e1 tempest-VolumeDependencyTests-581964465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:50:24 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-f01ea130-1e08-4e72-8138-1b47974671e1 tempest-VolumeDependencyTests-581964465 None] Flow 'volume_create_manager' (108b5b4e-4b84-4b01-8009-c19c262413ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:25 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-f01ea130-1e08-4e72-8138-1b47974671e1 tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e2b563f-785c-4f69-b85e-e8ecd59cfbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:25 devstack sudo[91598]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:25 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-f01ea130-1e08-4e72-8138-1b47974671e1 tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e2b563f-785c-4f69-b85e-e8ecd59cfbe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1795698503',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0a6fda7-1a49-497b-b913-d3e61e68d96e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a88a855c6524bad869cffeef21a285b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:25Z,use_quota=True,user_id='37cf0981063b41cd9dda2cbc314a761f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:25 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-f01ea130-1e08-4e72-8138-1b47974671e1 tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60ccb4fd-8765-49e4-b83d-fc1f81c3d9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:25 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-f01ea130-1e08-4e72-8138-1b47974671e1 tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60ccb4fd-8765-49e4-b83d-fc1f81c3d9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:25 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-f01ea130-1e08-4e72-8138-1b47974671e1 tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db3897fb-ca08-4b68-937c-30dc8fb9470c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:25 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-f01ea130-1e08-4e72-8138-1b47974671e1 tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db3897fb-ca08-4b68-937c-30dc8fb9470c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0a6fda7-1a49-497b-b913-d3e61e68d96e', 'volume_name': 'volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:25 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-f01ea130-1e08-4e72-8138-1b47974671e1 tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70cc470d-257b-42b8-bef0-87a56162cece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:25 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-f01ea130-1e08-4e72-8138-1b47974671e1 tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70cc470d-257b-42b8-bef0-87a56162cece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:25 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-f01ea130-1e08-4e72-8138-1b47974671e1 tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2194b71-ce06-41da-bb9e-9875a96013eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:25 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-f01ea130-1e08-4e72-8138-1b47974671e1 tempest-VolumeDependencyTests-581964465 None] Volume e0a6fda7-1a49-497b-b913-d3e61e68d96e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e', 'volume_size': 1}
Feb 28 04:50:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-f01ea130-1e08-4e72-8138-1b47974671e1 tempest-VolumeDependencyTests-581964465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d75a8751-12a1-48f5-867c-01033a4062cf tempest-CreateVolumesFromSnapshotTest-1134726136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1e600966-331a-417d-99fa-07b90aaa1408 1073741824" returned: 0 in 0.593s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d75a8751-12a1-48f5-867c-01033a4062cf tempest-CreateVolumesFromSnapshotTest-1134726136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1e600966-331a-417d-99fa-07b90aaa1408 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:25 devstack sudo[91610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1e600966-331a-417d-99fa-07b90aaa1408
Feb 28 04:50:25 devstack sudo[91610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:25 devstack sudo[91601]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.511s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:25 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-c7c8cbf8-bf08-4821-a73f-2f99a2a5debd None None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:50:25 devstack sudo[91603]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5a3c5ec3-70d3-4ddf-a46e-132627e42a2d tempest-VolumeDependencyTests-581964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.451s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:25 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-5a3c5ec3-70d3-4ddf-a46e-132627e42a2d tempest-VolumeDependencyTests-581964465 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:50:25 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-5a3c5ec3-70d3-4ddf-a46e-132627e42a2d tempest-VolumeDependencyTests-581964465 None] Deleted volume successfully.
Feb 28 04:50:25 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-5a3c5ec3-70d3-4ddf-a46e-132627e42a2d tempest-VolumeDependencyTests-581964465 None] Lock "cinder-8cc32111-3c25-4f27-ad03-fb7fa45952b2-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:25 devstack sudo[91610]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d75a8751-12a1-48f5-867c-01033a4062cf tempest-CreateVolumesFromSnapshotTest-1134726136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1e600966-331a-417d-99fa-07b90aaa1408" returned: 0 in 0.406s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:25 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-d75a8751-12a1-48f5-867c-01033a4062cf tempest-CreateVolumesFromSnapshotTest-1134726136 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:50:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d75a8751-12a1-48f5-867c-01033a4062cf tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b42b40ab-13d6-41a8-bb44-06c0184af9bd tempest-CinderUnicodeTest-1234426951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.727s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:25 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-b42b40ab-13d6-41a8-bb44-06c0184af9bd tempest-CinderUnicodeTest-1234426951 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9530667f-3750-4db5-a0df-202de6ba1cca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7e7b747ffcb40f4ae79cb2fa4814188',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:22Z,use_quota=True,user_id='a5d7a4047abe4bc094cd348e3c3efb67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:50:25 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-b42b40ab-13d6-41a8-bb44-06c0184af9bd tempest-CinderUnicodeTest-1234426951 None] Creating volume 9530667f-3750-4db5-a0df-202de6ba1cca {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:50:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b42b40ab-13d6-41a8-bb44-06c0184af9bd tempest-CinderUnicodeTest-1234426951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b42b40ab-13d6-41a8-bb44-06c0184af9bd tempest-CinderUnicodeTest-1234426951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:25 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-b42b40ab-13d6-41a8-bb44-06c0184af9bd tempest-CinderUnicodeTest-1234426951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:25 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-b42b40ab-13d6-41a8-bb44-06c0184af9bd tempest-CinderUnicodeTest-1234426951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b42b40ab-13d6-41a8-bb44-06c0184af9bd tempest-CinderUnicodeTest-1234426951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:25 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-b42b40ab-13d6-41a8-bb44-06c0184af9bd tempest-CinderUnicodeTest-1234426951 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:50:25 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-b42b40ab-13d6-41a8-bb44-06c0184af9bd tempest-CinderUnicodeTest-1234426951 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:50:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b42b40ab-13d6-41a8-bb44-06c0184af9bd tempest-CinderUnicodeTest-1234426951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9530667f-3750-4db5-a0df-202de6ba1cca 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:25 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d75a8751-12a1-48f5-867c-01033a4062cf tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3de9597a-f3b8-47e0-8a66-94c3444e86ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e600966-331a-417d-99fa-07b90aaa1408', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:25 devstack sudo[91613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9530667f-3750-4db5-a0df-202de6ba1cca 1073741824
Feb 28 04:50:25 devstack sudo[91613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:25 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d75a8751-12a1-48f5-867c-01033a4062cf tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59e40497-0156-4f71-998f-73a468ac0d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:25 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-d75a8751-12a1-48f5-867c-01033a4062cf tempest-CreateVolumesFromSnapshotTest-1134726136 None] Volume volume-1e600966-331a-417d-99fa-07b90aaa1408 (1e600966-331a-417d-99fa-07b90aaa1408): created successfully
Feb 28 04:50:25 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d75a8751-12a1-48f5-867c-01033a4062cf tempest-CreateVolumesFromSnapshotTest-1134726136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59e40497-0156-4f71-998f-73a468ac0d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:25 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-d75a8751-12a1-48f5-867c-01033a4062cf tempest-CreateVolumesFromSnapshotTest-1134726136 None] Flow 'volume_create_manager' (02e3aad3-bb4a-44ee-a29f-566552ddc494) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:25 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-d75a8751-12a1-48f5-867c-01033a4062cf tempest-CreateVolumesFromSnapshotTest-1134726136 None] Created volume successfully.
Feb 28 04:50:25 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ffe2221d-d06d-4bae-90ce-9e45cf4143ec tempest-CreateVolumesFromSnapshotTest-1134726136 None] Acquiring lock "cinder-1e600966-331a-417d-99fa-07b90aaa1408-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:25 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ffe2221d-d06d-4bae-90ce-9e45cf4143ec tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "cinder-1e600966-331a-417d-99fa-07b90aaa1408-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:25 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ffe2221d-d06d-4bae-90ce-9e45cf4143ec tempest-CreateVolumesFromSnapshotTest-1134726136 None] Acquiring lock "cinder-quobyte-1e600966-331a-417d-99fa-07b90aaa1408" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:25 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ffe2221d-d06d-4bae-90ce-9e45cf4143ec tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "cinder-quobyte-1e600966-331a-417d-99fa-07b90aaa1408" acquired by "delete_volume" :: waited 0.011s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:25 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6c65a8-8604-4604-9300-8abfedadfdf8]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ffe2221d-d06d-4bae-90ce-9e45cf4143ec tempest-CreateVolumesFromSnapshotTest-1134726136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1e600966-331a-417d-99fa-07b90aaa1408 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:25 devstack sudo[91615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1e600966-331a-417d-99fa-07b90aaa1408
Feb 28 04:50:25 devstack sudo[91615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:25 devstack sudo[91613]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b42b40ab-13d6-41a8-bb44-06c0184af9bd tempest-CinderUnicodeTest-1234426951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9530667f-3750-4db5-a0df-202de6ba1cca 1073741824" returned: 0 in 0.476s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:25 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b42b40ab-13d6-41a8-bb44-06c0184af9bd tempest-CinderUnicodeTest-1234426951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9530667f-3750-4db5-a0df-202de6ba1cca {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:25 devstack sudo[91620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9530667f-3750-4db5-a0df-202de6ba1cca
Feb 28 04:50:25 devstack sudo[91620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:26 devstack sudo[91615]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ffe2221d-d06d-4bae-90ce-9e45cf4143ec tempest-CreateVolumesFromSnapshotTest-1134726136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1e600966-331a-417d-99fa-07b90aaa1408" returned: 0 in 0.483s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ffe2221d-d06d-4bae-90ce-9e45cf4143ec tempest-CreateVolumesFromSnapshotTest-1134726136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1e600966-331a-417d-99fa-07b90aaa1408 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:26 devstack sudo[91625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1e600966-331a-417d-99fa-07b90aaa1408
Feb 28 04:50:26 devstack sudo[91625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:26 devstack sudo[91620]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-b42b40ab-13d6-41a8-bb44-06c0184af9bd tempest-CinderUnicodeTest-1234426951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9530667f-3750-4db5-a0df-202de6ba1cca" returned: 0 in 0.398s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:26 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-b42b40ab-13d6-41a8-bb44-06c0184af9bd tempest-CinderUnicodeTest-1234426951 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:50:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-b42b40ab-13d6-41a8-bb44-06c0184af9bd tempest-CinderUnicodeTest-1234426951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-466891d7-0b4d-4dd0-b14d-9ad5d79dd20d tempest-SnapshotDependencyTests-1591423573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.559s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:26 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b42b40ab-13d6-41a8-bb44-06c0184af9bd tempest-CinderUnicodeTest-1234426951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01d7b707-7587-4b40-8a6d-d4c1a7830f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9530667f-3750-4db5-a0df-202de6ba1cca', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:26 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b42b40ab-13d6-41a8-bb44-06c0184af9bd tempest-CinderUnicodeTest-1234426951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91af60cf-e1a2-4cfc-81fa-6ecc0c824498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:26 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-466891d7-0b4d-4dd0-b14d-9ad5d79dd20d tempest-SnapshotDependencyTests-1591423573 None] Creating offline snapshot 150aedaf-467e-40f2-b98a-cc34f12791fc of volume a5e67871-e782-40e6-8711-08bc89eb2cd1 {{(pid=84248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 04:50:26 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-b42b40ab-13d6-41a8-bb44-06c0184af9bd tempest-CinderUnicodeTest-1234426951 None] Volume volume-9530667f-3750-4db5-a0df-202de6ba1cca (9530667f-3750-4db5-a0df-202de6ba1cca): created successfully
Feb 28 04:50:26 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b42b40ab-13d6-41a8-bb44-06c0184af9bd tempest-CinderUnicodeTest-1234426951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91af60cf-e1a2-4cfc-81fa-6ecc0c824498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:26 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-b42b40ab-13d6-41a8-bb44-06c0184af9bd tempest-CinderUnicodeTest-1234426951 None] Flow 'volume_create_manager' (ec90909c-d8a6-4e01-b691-e2a15d537ebf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:26 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[c500e862-3037-4ee0-b2a4-804db4bb622f]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-466891d7-0b4d-4dd0-b14d-9ad5d79dd20d tempest-SnapshotDependencyTests-1591423573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:26 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-b42b40ab-13d6-41a8-bb44-06c0184af9bd tempest-CinderUnicodeTest-1234426951 None] Created volume successfully.
Feb 28 04:50:26 devstack sudo[91628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1
Feb 28 04:50:26 devstack sudo[91628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:26 devstack sudo[91625]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ffe2221d-d06d-4bae-90ce-9e45cf4143ec tempest-CreateVolumesFromSnapshotTest-1134726136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-1e600966-331a-417d-99fa-07b90aaa1408" returned: 0 in 0.404s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:26 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ffe2221d-d06d-4bae-90ce-9e45cf4143ec tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "cinder-quobyte-1e600966-331a-417d-99fa-07b90aaa1408" released by "delete_volume" :: held 0.919s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:26 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-ffe2221d-d06d-4bae-90ce-9e45cf4143ec tempest-CreateVolumesFromSnapshotTest-1134726136 None] Created reservations ['81daf59c-ffeb-4b22-9ac2-2a5065e94a86', '2803c5a6-68d3-4117-b84c-b1284dc89751', '2eb22621-ea22-42cb-b596-67bd08d44838', '3905909d-1094-42ff-9929-2d7fa8e4cffc'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:50:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ffe2221d-d06d-4bae-90ce-9e45cf4143ec tempest-CreateVolumesFromSnapshotTest-1134726136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ffe2221d-d06d-4bae-90ce-9e45cf4143ec tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:26 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-ffe2221d-d06d-4bae-90ce-9e45cf4143ec tempest-CreateVolumesFromSnapshotTest-1134726136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:26 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-ffe2221d-d06d-4bae-90ce-9e45cf4143ec tempest-CreateVolumesFromSnapshotTest-1134726136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ffe2221d-d06d-4bae-90ce-9e45cf4143ec tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ffe2221d-d06d-4bae-90ce-9e45cf4143ec tempest-CreateVolumesFromSnapshotTest-1134726136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:26 devstack sudo[91631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:50:26 devstack sudo[91631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:26 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-53b9421f-9405-4045-a50e-4a17b77fa495 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Acquiring lock "cinder-a4584583-8750-4322-87aa-ad9d417cebf7-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:26 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-53b9421f-9405-4045-a50e-4a17b77fa495 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "cinder-a4584583-8750-4322-87aa-ad9d417cebf7-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:26 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-53b9421f-9405-4045-a50e-4a17b77fa495 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Acquiring lock "cinder-quobyte-a4584583-8750-4322-87aa-ad9d417cebf7" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:26 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-53b9421f-9405-4045-a50e-4a17b77fa495 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "cinder-quobyte-a4584583-8750-4322-87aa-ad9d417cebf7" acquired by "delete_volume" :: waited 0.015s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:26 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30c9b8a-2745-4232-961b-fd994df5943d]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-53b9421f-9405-4045-a50e-4a17b77fa495 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a4584583-8750-4322-87aa-ad9d417cebf7 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:26 devstack sudo[91628]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-466891d7-0b4d-4dd0-b14d-9ad5d79dd20d tempest-SnapshotDependencyTests-1591423573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1" returned: 0 in 0.519s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:26 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-466891d7-0b4d-4dd0-b14d-9ad5d79dd20d tempest-SnapshotDependencyTests-1591423573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1.150aedaf-467e-40f2-b98a-cc34f12791fc 1G {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:26 devstack sudo[91637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1.150aedaf-467e-40f2-b98a-cc34f12791fc 1G
Feb 28 04:50:26 devstack sudo[91637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:26 devstack sudo[91636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a4584583-8750-4322-87aa-ad9d417cebf7
Feb 28 04:50:26 devstack sudo[91636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:27 devstack sudo[91631]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:27 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ffe2221d-d06d-4bae-90ce-9e45cf4143ec tempest-CreateVolumesFromSnapshotTest-1134726136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.460s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:27 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-ffe2221d-d06d-4bae-90ce-9e45cf4143ec tempest-CreateVolumesFromSnapshotTest-1134726136 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:50:27 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-ffe2221d-d06d-4bae-90ce-9e45cf4143ec tempest-CreateVolumesFromSnapshotTest-1134726136 None] Deleted volume successfully.
Feb 28 04:50:27 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-ffe2221d-d06d-4bae-90ce-9e45cf4143ec tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "cinder-1e600966-331a-417d-99fa-07b90aaa1408-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:27 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bedee55-64a7-454c-94c9-36f06ccd30c4 tempest-CinderUnicodeTest-1234426951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:50:27 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5bedee55-64a7-454c-94c9-36f06ccd30c4 tempest-CinderUnicodeTest-1234426951 None] Flow 'volume_create_manager' (fe3053e8-f67f-4a88-bab0-694453dcaf7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:27 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5bedee55-64a7-454c-94c9-36f06ccd30c4 tempest-CinderUnicodeTest-1234426951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7820c1a5-0aac-4446-aa68-f06931cf94aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:27 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5bedee55-64a7-454c-94c9-36f06ccd30c4 tempest-CinderUnicodeTest-1234426951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7820c1a5-0aac-4446-aa68-f06931cf94aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:27Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1171648319',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f4e332-dc2a-450e-8005-99a99f5d25a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7e7b747ffcb40f4ae79cb2fa4814188',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:27Z,use_quota=True,user_id='a5d7a4047abe4bc094cd348e3c3efb67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:27 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5bedee55-64a7-454c-94c9-36f06ccd30c4 tempest-CinderUnicodeTest-1234426951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4aaf6c6-aa7e-46c5-829e-b100f86022b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:27 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5bedee55-64a7-454c-94c9-36f06ccd30c4 tempest-CinderUnicodeTest-1234426951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4aaf6c6-aa7e-46c5-829e-b100f86022b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:27 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5bedee55-64a7-454c-94c9-36f06ccd30c4 tempest-CinderUnicodeTest-1234426951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17b2c43c-0cda-4f47-91fe-30a95fe264c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:27 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5bedee55-64a7-454c-94c9-36f06ccd30c4 tempest-CinderUnicodeTest-1234426951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17b2c43c-0cda-4f47-91fe-30a95fe264c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61f4e332-dc2a-450e-8005-99a99f5d25a1', 'volume_name': 'volume-61f4e332-dc2a-450e-8005-99a99f5d25a1', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:27 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5bedee55-64a7-454c-94c9-36f06ccd30c4 tempest-CinderUnicodeTest-1234426951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17c733d9-ffc0-4d74-9b32-aaeca7afcda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:27 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5bedee55-64a7-454c-94c9-36f06ccd30c4 tempest-CinderUnicodeTest-1234426951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17c733d9-ffc0-4d74-9b32-aaeca7afcda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:27 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5bedee55-64a7-454c-94c9-36f06ccd30c4 tempest-CinderUnicodeTest-1234426951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b31b3d2-a405-4b7b-86ea-b4f36953e2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:27 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-5bedee55-64a7-454c-94c9-36f06ccd30c4 tempest-CinderUnicodeTest-1234426951 None] Volume 61f4e332-dc2a-450e-8005-99a99f5d25a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61f4e332-dc2a-450e-8005-99a99f5d25a1', 'volume_size': 1}
Feb 28 04:50:27 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5bedee55-64a7-454c-94c9-36f06ccd30c4 tempest-CinderUnicodeTest-1234426951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:27 devstack sudo[91636]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:27 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-53b9421f-9405-4045-a50e-4a17b77fa495 tempest-CreateVolumesFromSnapshotTest-1134726136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a4584583-8750-4322-87aa-ad9d417cebf7" returned: 0 in 0.616s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:27 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-53b9421f-9405-4045-a50e-4a17b77fa495 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a4584583-8750-4322-87aa-ad9d417cebf7 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:27 devstack sudo[91647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a4584583-8750-4322-87aa-ad9d417cebf7
Feb 28 04:50:27 devstack sudo[91647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:27 devstack sudo[91637]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:27 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-466891d7-0b4d-4dd0-b14d-9ad5d79dd20d tempest-SnapshotDependencyTests-1591423573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1.150aedaf-467e-40f2-b98a-cc34f12791fc 1G" returned: 0 in 0.618s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:27 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-466891d7-0b4d-4dd0-b14d-9ad5d79dd20d tempest-SnapshotDependencyTests-1591423573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5e67871-e782-40e6-8711-08bc89eb2cd1 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1.150aedaf-467e-40f2-b98a-cc34f12791fc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:27 devstack sudo[91649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5e67871-e782-40e6-8711-08bc89eb2cd1 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1.150aedaf-467e-40f2-b98a-cc34f12791fc
Feb 28 04:50:27 devstack sudo[91649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:27 devstack sudo[91647]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:27 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-53b9421f-9405-4045-a50e-4a17b77fa495 tempest-CreateVolumesFromSnapshotTest-1134726136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a4584583-8750-4322-87aa-ad9d417cebf7" returned: 0 in 0.453s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:27 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-53b9421f-9405-4045-a50e-4a17b77fa495 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "cinder-quobyte-a4584583-8750-4322-87aa-ad9d417cebf7" released by "delete_volume" :: held 1.093s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:27 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-53b9421f-9405-4045-a50e-4a17b77fa495 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Created reservations ['55ed0b69-c053-4740-a3ff-15345bcd1527', 'fe4455fa-3211-4206-9e0d-1a8ee6056ba4', 'df0865ff-ae7d-43f5-b19b-eb85d5ec4a70', 'aca67968-64b7-44df-a5bf-4b17eb899cee'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:50:28 devstack sudo[91649]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-466891d7-0b4d-4dd0-b14d-9ad5d79dd20d tempest-SnapshotDependencyTests-1591423573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5e67871-e782-40e6-8711-08bc89eb2cd1 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1.150aedaf-467e-40f2-b98a-cc34f12791fc" returned: 0 in 0.447s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:28 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-466891d7-0b4d-4dd0-b14d-9ad5d79dd20d tempest-SnapshotDependencyTests-1591423573 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1.150aedaf-467e-40f2-b98a-cc34f12791fc is being set with open permissions: ugo+rw
Feb 28 04:50:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-466891d7-0b4d-4dd0-b14d-9ad5d79dd20d tempest-SnapshotDependencyTests-1591423573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1.150aedaf-467e-40f2-b98a-cc34f12791fc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:28 devstack sudo[91656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1.150aedaf-467e-40f2-b98a-cc34f12791fc
Feb 28 04:50:28 devstack sudo[91656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-53b9421f-9405-4045-a50e-4a17b77fa495 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-53b9421f-9405-4045-a50e-4a17b77fa495 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:28 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-53b9421f-9405-4045-a50e-4a17b77fa495 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:28 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-53b9421f-9405-4045-a50e-4a17b77fa495 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-53b9421f-9405-4045-a50e-4a17b77fa495 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-53b9421f-9405-4045-a50e-4a17b77fa495 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:28 devstack sudo[91658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:50:28 devstack sudo[91658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:28 devstack sudo[91656]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-466891d7-0b4d-4dd0-b14d-9ad5d79dd20d tempest-SnapshotDependencyTests-1591423573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1.150aedaf-467e-40f2-b98a-cc34f12791fc" returned: 0 in 0.410s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-466891d7-0b4d-4dd0-b14d-9ad5d79dd20d tempest-SnapshotDependencyTests-1591423573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:28 devstack sudo[91658]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-53b9421f-9405-4045-a50e-4a17b77fa495 tempest-CreateVolumesFromSnapshotTest-1134726136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.406s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:28 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-53b9421f-9405-4045-a50e-4a17b77fa495 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:50:28 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-53b9421f-9405-4045-a50e-4a17b77fa495 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Deleted volume successfully.
Feb 28 04:50:28 devstack sudo[91662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1.info
Feb 28 04:50:28 devstack sudo[91662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:28 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-53b9421f-9405-4045-a50e-4a17b77fa495 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "cinder-a4584583-8750-4322-87aa-ad9d417cebf7-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:28 devstack sudo[91662]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-466891d7-0b4d-4dd0-b14d-9ad5d79dd20d tempest-SnapshotDependencyTests-1591423573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1.info" returned: 0 in 0.433s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:28 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-466891d7-0b4d-4dd0-b14d-9ad5d79dd20d tempest-SnapshotDependencyTests-1591423573 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1.info is being set with open permissions: ugo+rw
Feb 28 04:50:28 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-466891d7-0b4d-4dd0-b14d-9ad5d79dd20d tempest-SnapshotDependencyTests-1591423573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:28 devstack sudo[91665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1.info
Feb 28 04:50:28 devstack sudo[91665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:28 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-9ece8e62-4de7-4334-86a8-ef8fcf699f24 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Acquiring lock "cinder-50e4dbfc-d58b-4df6-bb40-83fcf8fac321-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:28 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-9ece8e62-4de7-4334-86a8-ef8fcf699f24 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "cinder-50e4dbfc-d58b-4df6-bb40-83fcf8fac321-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:29 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-9ece8e62-4de7-4334-86a8-ef8fcf699f24 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Acquiring lock "cinder-quobyte-50e4dbfc-d58b-4df6-bb40-83fcf8fac321" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:29 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-9ece8e62-4de7-4334-86a8-ef8fcf699f24 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "cinder-quobyte-50e4dbfc-d58b-4df6-bb40-83fcf8fac321" acquired by "delete_volume" :: waited 0.007s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:29 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ca16fd-d6db-402a-8d28-c4d70b367e06]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9ece8e62-4de7-4334-86a8-ef8fcf699f24 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-50e4dbfc-d58b-4df6-bb40-83fcf8fac321 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:29 devstack sudo[91667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-50e4dbfc-d58b-4df6-bb40-83fcf8fac321
Feb 28 04:50:29 devstack sudo[91667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:29 devstack sudo[91665]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-466891d7-0b4d-4dd0-b14d-9ad5d79dd20d tempest-SnapshotDependencyTests-1591423573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1.info" returned: 0 in 0.441s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-466891d7-0b4d-4dd0-b14d-9ad5d79dd20d tempest-SnapshotDependencyTests-1591423573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.950s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-f01ea130-1e08-4e72-8138-1b47974671e1 tempest-VolumeDependencyTests-581964465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.293s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:29 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-f01ea130-1e08-4e72-8138-1b47974671e1 tempest-VolumeDependencyTests-581964465 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1795698503',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0a6fda7-1a49-497b-b913-d3e61e68d96e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a88a855c6524bad869cffeef21a285b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:25Z,use_quota=True,user_id='37cf0981063b41cd9dda2cbc314a761f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:50:29 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-f01ea130-1e08-4e72-8138-1b47974671e1 tempest-VolumeDependencyTests-581964465 None] Creating volume e0a6fda7-1a49-497b-b913-d3e61e68d96e {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:50:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-f01ea130-1e08-4e72-8138-1b47974671e1 tempest-VolumeDependencyTests-581964465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-f01ea130-1e08-4e72-8138-1b47974671e1 tempest-VolumeDependencyTests-581964465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:29 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-f01ea130-1e08-4e72-8138-1b47974671e1 tempest-VolumeDependencyTests-581964465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:29 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-f01ea130-1e08-4e72-8138-1b47974671e1 tempest-VolumeDependencyTests-581964465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-f01ea130-1e08-4e72-8138-1b47974671e1 tempest-VolumeDependencyTests-581964465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:29 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-f01ea130-1e08-4e72-8138-1b47974671e1 tempest-VolumeDependencyTests-581964465 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:50:29 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-f01ea130-1e08-4e72-8138-1b47974671e1 tempest-VolumeDependencyTests-581964465 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:50:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f01ea130-1e08-4e72-8138-1b47974671e1 tempest-VolumeDependencyTests-581964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:29 devstack sudo[91670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e 1073741824
Feb 28 04:50:29 devstack sudo[91670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:29 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-466891d7-0b4d-4dd0-b14d-9ad5d79dd20d tempest-SnapshotDependencyTests-1591423573 None] Create snapshot completed successfully
Feb 28 04:50:29 devstack sudo[91667]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9ece8e62-4de7-4334-86a8-ef8fcf699f24 tempest-CreateVolumesFromSnapshotTest-1134726136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-50e4dbfc-d58b-4df6-bb40-83fcf8fac321" returned: 0 in 0.496s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9ece8e62-4de7-4334-86a8-ef8fcf699f24 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-50e4dbfc-d58b-4df6-bb40-83fcf8fac321 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:29 devstack sudo[91675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-50e4dbfc-d58b-4df6-bb40-83fcf8fac321
Feb 28 04:50:29 devstack sudo[91675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:29 devstack sudo[91670]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f01ea130-1e08-4e72-8138-1b47974671e1 tempest-VolumeDependencyTests-581964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e 1073741824" returned: 0 in 0.471s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:29 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f01ea130-1e08-4e72-8138-1b47974671e1 tempest-VolumeDependencyTests-581964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:29 devstack sudo[91681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e
Feb 28 04:50:29 devstack sudo[91681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:30 devstack sudo[91675]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9ece8e62-4de7-4334-86a8-ef8fcf699f24 tempest-CreateVolumesFromSnapshotTest-1134726136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-50e4dbfc-d58b-4df6-bb40-83fcf8fac321" returned: 0 in 0.425s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:30 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-9ece8e62-4de7-4334-86a8-ef8fcf699f24 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "cinder-quobyte-50e4dbfc-d58b-4df6-bb40-83fcf8fac321" released by "delete_volume" :: held 0.945s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:30 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-9ece8e62-4de7-4334-86a8-ef8fcf699f24 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Created reservations ['bb30ff0b-deac-435c-a5e5-b391ddf51538', '723b793f-e8b1-4667-b4e2-b513b2179346', 'c9e64215-7507-495a-b165-5266d5b368e3', 'fe4197d6-b105-454d-aa64-97712e4b9ff9'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:50:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-9ece8e62-4de7-4334-86a8-ef8fcf699f24 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-9ece8e62-4de7-4334-86a8-ef8fcf699f24 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:30 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-9ece8e62-4de7-4334-86a8-ef8fcf699f24 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:30 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-9ece8e62-4de7-4334-86a8-ef8fcf699f24 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-9ece8e62-4de7-4334-86a8-ef8fcf699f24 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9ece8e62-4de7-4334-86a8-ef8fcf699f24 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:30 devstack sudo[91684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:50:30 devstack sudo[91684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:30 devstack sudo[91681]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f01ea130-1e08-4e72-8138-1b47974671e1 tempest-VolumeDependencyTests-581964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e" returned: 0 in 0.389s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:30 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-f01ea130-1e08-4e72-8138-1b47974671e1 tempest-VolumeDependencyTests-581964465 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:50:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-f01ea130-1e08-4e72-8138-1b47974671e1 tempest-VolumeDependencyTests-581964465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5bedee55-64a7-454c-94c9-36f06ccd30c4 tempest-CinderUnicodeTest-1234426951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.987s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:30 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-5bedee55-64a7-454c-94c9-36f06ccd30c4 tempest-CinderUnicodeTest-1234426951 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:27Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1171648319',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f4e332-dc2a-450e-8005-99a99f5d25a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7e7b747ffcb40f4ae79cb2fa4814188',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:27Z,use_quota=True,user_id='a5d7a4047abe4bc094cd348e3c3efb67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:50:30 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-5bedee55-64a7-454c-94c9-36f06ccd30c4 tempest-CinderUnicodeTest-1234426951 None] Creating volume 61f4e332-dc2a-450e-8005-99a99f5d25a1 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:50:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5bedee55-64a7-454c-94c9-36f06ccd30c4 tempest-CinderUnicodeTest-1234426951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5bedee55-64a7-454c-94c9-36f06ccd30c4 tempest-CinderUnicodeTest-1234426951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:30 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-5bedee55-64a7-454c-94c9-36f06ccd30c4 tempest-CinderUnicodeTest-1234426951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:30 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-5bedee55-64a7-454c-94c9-36f06ccd30c4 tempest-CinderUnicodeTest-1234426951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5bedee55-64a7-454c-94c9-36f06ccd30c4 tempest-CinderUnicodeTest-1234426951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:30 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-5bedee55-64a7-454c-94c9-36f06ccd30c4 tempest-CinderUnicodeTest-1234426951 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:50:30 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-5bedee55-64a7-454c-94c9-36f06ccd30c4 tempest-CinderUnicodeTest-1234426951 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:50:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5bedee55-64a7-454c-94c9-36f06ccd30c4 tempest-CinderUnicodeTest-1234426951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:30 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-f01ea130-1e08-4e72-8138-1b47974671e1 tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2194b71-ce06-41da-bb9e-9875a96013eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:30 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-f01ea130-1e08-4e72-8138-1b47974671e1 tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bcd1666-21e8-4377-acdd-151f45c4c914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:30 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-f01ea130-1e08-4e72-8138-1b47974671e1 tempest-VolumeDependencyTests-581964465 None] Volume volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e (e0a6fda7-1a49-497b-b913-d3e61e68d96e): created successfully
Feb 28 04:50:30 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-f01ea130-1e08-4e72-8138-1b47974671e1 tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bcd1666-21e8-4377-acdd-151f45c4c914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:30 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-f01ea130-1e08-4e72-8138-1b47974671e1 tempest-VolumeDependencyTests-581964465 None] Flow 'volume_create_manager' (108b5b4e-4b84-4b01-8009-c19c262413ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:30 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-f01ea130-1e08-4e72-8138-1b47974671e1 tempest-VolumeDependencyTests-581964465 None] Created volume successfully.
Feb 28 04:50:30 devstack sudo[91687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1 1073741824
Feb 28 04:50:30 devstack sudo[91687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:30 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:50:30 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Flow 'volume_create_manager' (1b11c0ac-0603-48fa-be69-efceaf0e6e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:30 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (945491d4-2f70-4c7b-9bbe-0416837fb285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:30 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (945491d4-2f70-4c7b-9bbe-0416837fb285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6f0320c-dbe9-454d-9692-0004d0337125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='862ac588ffbd4bf694a9b4854ead8e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=150aedaf-467e-40f2-b98a-cc34f12791fc,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:30Z,use_quota=True,user_id='582a5471f36044bfba4cbb4618fc8951',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:30 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39bf86b0-29c5-4e45-817a-87ef2af8e680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:30 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39bf86b0-29c5-4e45-817a-87ef2af8e680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:30 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc27ae08-6122-46cd-a5ce-4b0bc669db44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:30 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc27ae08-6122-46cd-a5ce-4b0bc669db44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b6f0320c-dbe9-454d-9692-0004d0337125', 'volume_name': 'volume-b6f0320c-dbe9-454d-9692-0004d0337125', 'volume_size': 1, 'snapshot_id': '150aedaf-467e-40f2-b98a-cc34f12791fc'}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:30 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba1e67e9-2b63-44c4-aa28-505de6d2a22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:30 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba1e67e9-2b63-44c4-aa28-505de6d2a22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:30 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (772a7fc9-e8c1-433a-9736-0e0c09d71591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:30 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Volume b6f0320c-dbe9-454d-9692-0004d0337125: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b6f0320c-dbe9-454d-9692-0004d0337125', 'volume_size': 1, 'snapshot_id': '150aedaf-467e-40f2-b98a-cc34f12791fc'}
Feb 28 04:50:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:30 devstack sudo[91684]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9ece8e62-4de7-4334-86a8-ef8fcf699f24 tempest-CreateVolumesFromSnapshotTest-1134726136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.486s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:30 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-9ece8e62-4de7-4334-86a8-ef8fcf699f24 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:50:30 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-9ece8e62-4de7-4334-86a8-ef8fcf699f24 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Deleted volume successfully.
Feb 28 04:50:30 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-9ece8e62-4de7-4334-86a8-ef8fcf699f24 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "cinder-50e4dbfc-d58b-4df6-bb40-83fcf8fac321-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:30 devstack sudo[91687]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5bedee55-64a7-454c-94c9-36f06ccd30c4 tempest-CinderUnicodeTest-1234426951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1 1073741824" returned: 0 in 0.496s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:30 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5bedee55-64a7-454c-94c9-36f06ccd30c4 tempest-CinderUnicodeTest-1234426951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:30 devstack sudo[91693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1
Feb 28 04:50:30 devstack sudo[91693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:31 devstack sudo[91693]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5bedee55-64a7-454c-94c9-36f06ccd30c4 tempest-CinderUnicodeTest-1234426951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1" returned: 0 in 0.409s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-5bedee55-64a7-454c-94c9-36f06ccd30c4 tempest-CinderUnicodeTest-1234426951 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5bedee55-64a7-454c-94c9-36f06ccd30c4 tempest-CinderUnicodeTest-1234426951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.681s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Acquiring lock "cinder-quobyte-150aedaf-467e-40f2-b98a-cc34f12791fc-b6f0320c-dbe9-454d-9692-0004d0337125" by "_create_volume_from_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5bedee55-64a7-454c-94c9-36f06ccd30c4 tempest-CinderUnicodeTest-1234426951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b31b3d2-a405-4b7b-86ea-b4f36953e2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61f4e332-dc2a-450e-8005-99a99f5d25a1', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5bedee55-64a7-454c-94c9-36f06ccd30c4 tempest-CinderUnicodeTest-1234426951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b22fe36c-75f7-4daa-9d67-0750aee963e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-97fad698-5a14-44df-8529-2c578653f3df tempest-CreateVolumesFromSnapshotTest-1134726136 None] Acquiring lock "cinder-5a8f2c1e-f639-4301-b70e-013257a81709-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:31 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-5bedee55-64a7-454c-94c9-36f06ccd30c4 tempest-CinderUnicodeTest-1234426951 None] Volume volume-61f4e332-dc2a-450e-8005-99a99f5d25a1 (61f4e332-dc2a-450e-8005-99a99f5d25a1): created successfully
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5bedee55-64a7-454c-94c9-36f06ccd30c4 tempest-CinderUnicodeTest-1234426951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b22fe36c-75f7-4daa-9d67-0750aee963e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-5bedee55-64a7-454c-94c9-36f06ccd30c4 tempest-CinderUnicodeTest-1234426951 None] Flow 'volume_create_manager' (fe3053e8-f67f-4a88-bab0-694453dcaf7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Lock "cinder-quobyte-150aedaf-467e-40f2-b98a-cc34f12791fc-b6f0320c-dbe9-454d-9692-0004d0337125" acquired by "_create_volume_from_snapshot" :: waited 0.047s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Creating volume b6f0320c-dbe9-454d-9692-0004d0337125 from snapshot 150aedaf-467e-40f2-b98a-cc34f12791fc {{(pid=84248) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Acquiring lock "cinder-quobyte-b6f0320c-dbe9-454d-9692-0004d0337125" by "_copy_volume_from_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:31 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-5bedee55-64a7-454c-94c9-36f06ccd30c4 tempest-CinderUnicodeTest-1234426951 None] Created volume successfully.
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-97fad698-5a14-44df-8529-2c578653f3df tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "cinder-5a8f2c1e-f639-4301-b70e-013257a81709-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Lock "cinder-quobyte-b6f0320c-dbe9-454d-9692-0004d0337125" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] snapshot: 150aedaf-467e-40f2-b98a-cc34f12791fc, volume: b6f0320c-dbe9-454d-9692-0004d0337125,  {{(pid=84248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99a10f0-6051-4259-b9da-cf78b483a1a4]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1.150aedaf-467e-40f2-b98a-cc34f12791fc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-97fad698-5a14-44df-8529-2c578653f3df tempest-CreateVolumesFromSnapshotTest-1134726136 None] Acquiring lock "cinder-quobyte-5a8f2c1e-f639-4301-b70e-013257a81709" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-97fad698-5a14-44df-8529-2c578653f3df tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "cinder-quobyte-5a8f2c1e-f639-4301-b70e-013257a81709" acquired by "delete_volume" :: waited 0.009s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[f491e6ce-5298-4d92-885a-574eaf44008b]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-97fad698-5a14-44df-8529-2c578653f3df tempest-CreateVolumesFromSnapshotTest-1134726136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-5a8f2c1e-f639-4301-b70e-013257a81709 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:31 devstack sudo[91696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1.150aedaf-467e-40f2-b98a-cc34f12791fc
Feb 28 04:50:31 devstack sudo[91696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:31 devstack sudo[91697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-5a8f2c1e-f639-4301-b70e-013257a81709
Feb 28 04:50:31 devstack sudo[91697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d2b79dda-ce56-49fe-a063-e4fcacf30dbd tempest-CinderUnicodeTest-1234426951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Flow 'volume_create_manager' (90172f5e-78cf-4285-b13f-2907a515c647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18f84082-c2a1-43a9-9e03-565a6e61ce10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18f84082-c2a1-43a9-9e03-565a6e61ce10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-469496594',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77a601ea-3219-440c-bf88-7c98ae15d303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a88a855c6524bad869cffeef21a285b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=e0a6fda7-1a49-497b-b913-d3e61e68d96e,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:32Z,use_quota=True,user_id='37cf0981063b41cd9dda2cbc314a761f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65e58509-882b-4799-91d3-a9f770f31bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65e58509-882b-4799-91d3-a9f770f31bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d65d0b1d-64ee-4681-b400-208036f90350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d65d0b1d-64ee-4681-b400-208036f90350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '77a601ea-3219-440c-bf88-7c98ae15d303', 'volume_name': 'volume-77a601ea-3219-440c-bf88-7c98ae15d303', 'volume_size': 1, 'source_volid': 'e0a6fda7-1a49-497b-b913-d3e61e68d96e', 'source_volstatus': 'available'}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dada4468-2630-416b-9e15-6f939bab1d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dada4468-2630-416b-9e15-6f939bab1d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1429f290-522f-43a0-8ecf-8b28076023ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:31 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Volume 77a601ea-3219-440c-bf88-7c98ae15d303: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-77a601ea-3219-440c-bf88-7c98ae15d303', 'volume_size': 1, 'source_volid': 'e0a6fda7-1a49-497b-b913-d3e61e68d96e', 'source_volstatus': 'available'}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:31 devstack sudo[91696]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1.150aedaf-467e-40f2-b98a-cc34f12791fc" returned: 0 in 0.509s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5e67871-e782-40e6-8711-08bc89eb2cd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] will copy from snapshot at /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1 {{(pid=84248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Creating direct copy from snapshot {{(pid=84248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab06cf1-2929-49ad-84eb-797282e7cb1a]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:31 devstack sudo[91703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1
Feb 28 04:50:31 devstack sudo[91703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:31 devstack sudo[91697]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-97fad698-5a14-44df-8529-2c578653f3df tempest-CreateVolumesFromSnapshotTest-1134726136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-5a8f2c1e-f639-4301-b70e-013257a81709" returned: 0 in 0.581s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:31 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-97fad698-5a14-44df-8529-2c578653f3df tempest-CreateVolumesFromSnapshotTest-1134726136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-5a8f2c1e-f639-4301-b70e-013257a81709 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:31 devstack sudo[91708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-5a8f2c1e-f639-4301-b70e-013257a81709
Feb 28 04:50:31 devstack sudo[91708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:32 devstack sudo[91703]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1" returned: 0 in 0.455s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:32 devstack cinder-volume[84248]: DEBUG cinder.utils [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Path /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b6f0320c-dbe9-454d-9692-0004d0337125 not found in is_blk_device check {{(pid=84248) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 28 04:50:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b6f0320c-dbe9-454d-9692-0004d0337125 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:32 devstack sudo[91714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b6f0320c-dbe9-454d-9692-0004d0337125
Feb 28 04:50:32 devstack sudo[91714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:32 devstack sudo[91708]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-97fad698-5a14-44df-8529-2c578653f3df tempest-CreateVolumesFromSnapshotTest-1134726136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-5a8f2c1e-f639-4301-b70e-013257a81709" returned: 0 in 0.412s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:32 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-97fad698-5a14-44df-8529-2c578653f3df tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "cinder-quobyte-5a8f2c1e-f639-4301-b70e-013257a81709" released by "delete_volume" :: held 1.014s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:32 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-97fad698-5a14-44df-8529-2c578653f3df tempest-CreateVolumesFromSnapshotTest-1134726136 None] Created reservations ['466b75f4-0566-4801-bc7f-dce90a52772b', '7a596409-19cd-4b12-930b-ab645d9687f2', '891991fc-cfb1-459d-ab8a-e85b78c83193', 'fe236b9b-519d-499f-adcb-bc8f44b609d9'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:50:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-97fad698-5a14-44df-8529-2c578653f3df tempest-CreateVolumesFromSnapshotTest-1134726136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-97fad698-5a14-44df-8529-2c578653f3df tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:32 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-97fad698-5a14-44df-8529-2c578653f3df tempest-CreateVolumesFromSnapshotTest-1134726136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:32 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-97fad698-5a14-44df-8529-2c578653f3df tempest-CreateVolumesFromSnapshotTest-1134726136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-97fad698-5a14-44df-8529-2c578653f3df tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-97fad698-5a14-44df-8529-2c578653f3df tempest-CreateVolumesFromSnapshotTest-1134726136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:32 devstack sudo[91716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:50:32 devstack sudo[91716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:32 devstack sudo[91716]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:32 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-97fad698-5a14-44df-8529-2c578653f3df tempest-CreateVolumesFromSnapshotTest-1134726136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.461s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:32 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-97fad698-5a14-44df-8529-2c578653f3df tempest-CreateVolumesFromSnapshotTest-1134726136 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:50:32 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-97fad698-5a14-44df-8529-2c578653f3df tempest-CreateVolumesFromSnapshotTest-1134726136 None] Deleted volume successfully.
Feb 28 04:50:32 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-97fad698-5a14-44df-8529-2c578653f3df tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "cinder-5a8f2c1e-f639-4301-b70e-013257a81709-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:33 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-eb06be64-bb6a-4058-aba4-c8f3369714b9 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Acquiring lock "cinder-91ae528f-f4f4-424d-8910-3363cb1e2ff8-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:33 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-eb06be64-bb6a-4058-aba4-c8f3369714b9 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "cinder-91ae528f-f4f4-424d-8910-3363cb1e2ff8-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:33 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-eb06be64-bb6a-4058-aba4-c8f3369714b9 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Acquiring lock "cinder-quobyte-91ae528f-f4f4-424d-8910-3363cb1e2ff8" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:33 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-eb06be64-bb6a-4058-aba4-c8f3369714b9 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "cinder-quobyte-91ae528f-f4f4-424d-8910-3363cb1e2ff8" acquired by "delete_volume" :: waited 0.017s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:33 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbae6f23-240e-4a42-8ef9-b7d71f910b18]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:33 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-eb06be64-bb6a-4058-aba4-c8f3369714b9 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-91ae528f-f4f4-424d-8910-3363cb1e2ff8 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:33 devstack sudo[91729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-91ae528f-f4f4-424d-8910-3363cb1e2ff8
Feb 28 04:50:33 devstack sudo[91729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:34 devstack sudo[91714]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:34 devstack sudo[91729]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-eb06be64-bb6a-4058-aba4-c8f3369714b9 tempest-CreateVolumesFromSnapshotTest-1134726136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-91ae528f-f4f4-424d-8910-3363cb1e2ff8" returned: 0 in 0.818s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b6f0320c-dbe9-454d-9692-0004d0337125" returned: 0 in 2.143s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-eb06be64-bb6a-4058-aba4-c8f3369714b9 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-91ae528f-f4f4-424d-8910-3363cb1e2ff8 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:34 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[503bbf58-a7e0-40b1-9278-51a6924ed34f]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:34 devstack sudo[91734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-91ae528f-f4f4-424d-8910-3363cb1e2ff8
Feb 28 04:50:34 devstack sudo[91734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:34 devstack sudo[91735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1
Feb 28 04:50:34 devstack sudo[91735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:34 devstack sudo[91734]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-eb06be64-bb6a-4058-aba4-c8f3369714b9 tempest-CreateVolumesFromSnapshotTest-1134726136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-91ae528f-f4f4-424d-8910-3363cb1e2ff8" returned: 0 in 0.399s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:34 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-eb06be64-bb6a-4058-aba4-c8f3369714b9 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "cinder-quobyte-91ae528f-f4f4-424d-8910-3363cb1e2ff8" released by "delete_volume" :: held 1.258s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:34 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-eb06be64-bb6a-4058-aba4-c8f3369714b9 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Created reservations ['d31eb7f1-c893-4512-bd58-8243ffba4db3', 'c159da8b-8780-45e1-97e9-f6a342116b9a', 'b43a2d12-cb6e-4251-bc62-1842a099c147', 'bb18f616-83c2-4aca-803e-55cbc75a764d'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:50:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-eb06be64-bb6a-4058-aba4-c8f3369714b9 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-eb06be64-bb6a-4058-aba4-c8f3369714b9 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:34 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-eb06be64-bb6a-4058-aba4-c8f3369714b9 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:34 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-eb06be64-bb6a-4058-aba4-c8f3369714b9 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-eb06be64-bb6a-4058-aba4-c8f3369714b9 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:34 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-eb06be64-bb6a-4058-aba4-c8f3369714b9 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:34 devstack sudo[91741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:50:34 devstack sudo[91741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:35 devstack sudo[91735]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1" returned: 0 in 0.624s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:35 devstack cinder-volume[84248]: DEBUG cinder.image.image_utils [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Image conversion details: src /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1, size 1024.00 MB, duration 2.15 sec, destination /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b6f0320c-dbe9-454d-9692-0004d0337125 {{(pid=84248) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 28 04:50:35 devstack cinder-volume[84248]: INFO cinder.image.image_utils [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Converted 1024.00 MB image at 475.97 MB/s
Feb 28 04:50:35 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b6f0320c-dbe9-454d-9692-0004d0337125 is being set with open permissions: ugo+rw
Feb 28 04:50:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b6f0320c-dbe9-454d-9692-0004d0337125 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:35 devstack sudo[91744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b6f0320c-dbe9-454d-9692-0004d0337125
Feb 28 04:50:35 devstack sudo[91744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:35 devstack sudo[91741]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-eb06be64-bb6a-4058-aba4-c8f3369714b9 tempest-CreateVolumesFromSnapshotTest-1134726136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.401s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:35 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-eb06be64-bb6a-4058-aba4-c8f3369714b9 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:50:35 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-eb06be64-bb6a-4058-aba4-c8f3369714b9 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Deleted volume successfully.
Feb 28 04:50:35 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-eb06be64-bb6a-4058-aba4-c8f3369714b9 tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "cinder-91ae528f-f4f4-424d-8910-3363cb1e2ff8-delete_volume" released by "delete_volume" :: held 1.845s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:35 devstack sudo[91744]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b6f0320c-dbe9-454d-9692-0004d0337125" returned: 0 in 0.397s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:35 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Lock "cinder-quobyte-b6f0320c-dbe9-454d-9692-0004d0337125" released by "_copy_volume_from_snapshot" :: held 4.192s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:35 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Lock "cinder-quobyte-150aedaf-467e-40f2-b98a-cc34f12791fc-b6f0320c-dbe9-454d-9692-0004d0337125" released by "_create_volume_from_snapshot" :: held 4.223s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.271s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d2b79dda-ce56-49fe-a063-e4fcacf30dbd tempest-CinderUnicodeTest-1234426951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.767s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:35 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-d2b79dda-ce56-49fe-a063-e4fcacf30dbd tempest-CinderUnicodeTest-1234426951 None] Creating offline snapshot 06282d50-ac19-4a67-94fb-04f7e374b20f of volume 61f4e332-dc2a-450e-8005-99a99f5d25a1 {{(pid=84248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 04:50:35 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (772a7fc9-e8c1-433a-9736-0e0c09d71591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6f0320c-dbe9-454d-9692-0004d0337125', 'volume_size': 1, 'snapshot_id': '150aedaf-467e-40f2-b98a-cc34f12791fc'}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:35 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (118fe8b0-6aa9-408c-ad04-431e921b4e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:35 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ca85d9-c00a-4c2c-a7f4-165c63c8c6e7]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d2b79dda-ce56-49fe-a063-e4fcacf30dbd tempest-CinderUnicodeTest-1234426951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:35 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Volume volume-b6f0320c-dbe9-454d-9692-0004d0337125 (b6f0320c-dbe9-454d-9692-0004d0337125): created successfully
Feb 28 04:50:35 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (118fe8b0-6aa9-408c-ad04-431e921b4e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:35 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Flow 'volume_create_manager' (1b11c0ac-0603-48fa-be69-efceaf0e6e27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:35 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-f09e0209-4844-4525-85b0-a9327e43d295 tempest-SnapshotDependencyTests-1591423573 None] Created volume successfully.
Feb 28 04:50:35 devstack sudo[91748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1
Feb 28 04:50:35 devstack sudo[91748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:35 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-56d59fcb-0b79-4759-94dd-430ae2c6b10b tempest-CreateVolumesFromSnapshotTest-1134726136 None] Acquiring lock "cinder-d400cc92-d8d8-4e96-a072-daae94887187-delete_snapshot" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:35 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-56d59fcb-0b79-4759-94dd-430ae2c6b10b tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "cinder-d400cc92-d8d8-4e96-a072-daae94887187-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:35 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-56d59fcb-0b79-4759-94dd-430ae2c6b10b tempest-CreateVolumesFromSnapshotTest-1134726136 None] Acquiring lock "cinder-quobyte-73d57c89-7228-43e4-ae94-e3cc2e050144" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:35 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-56d59fcb-0b79-4759-94dd-430ae2c6b10b tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "cinder-quobyte-73d57c89-7228-43e4-ae94-e3cc2e050144" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:35 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-56d59fcb-0b79-4759-94dd-430ae2c6b10b tempest-CreateVolumesFromSnapshotTest-1134726136 None] Acquiring lock "cinder-quobyte-d400cc92-d8d8-4e96-a072-daae94887187" by "_delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:35 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-56d59fcb-0b79-4759-94dd-430ae2c6b10b tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "cinder-quobyte-d400cc92-d8d8-4e96-a072-daae94887187" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:35 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-56d59fcb-0b79-4759-94dd-430ae2c6b10b tempest-CreateVolumesFromSnapshotTest-1134726136 None] Deleting offline snapshot d400cc92-d8d8-4e96-a072-daae94887187 of volume 73d57c89-7228-43e4-ae94-e3cc2e050144 {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 04:50:35 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-56d59fcb-0b79-4759-94dd-430ae2c6b10b tempest-CreateVolumesFromSnapshotTest-1134726136 None] snapshot_file for this snap is: volume-73d57c89-7228-43e4-ae94-e3cc2e050144.d400cc92-d8d8-4e96-a072-daae94887187 {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 04:50:35 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b43a5f4-b560-4360-9803-105da66f9ada]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-56d59fcb-0b79-4759-94dd-430ae2c6b10b tempest-CreateVolumesFromSnapshotTest-1134726136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144.d400cc92-d8d8-4e96-a072-daae94887187 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:35 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6f64893d-0dda-4c4a-9913-22addcf089e8 tempest-SnapshotDependencyTests-1591423573 None] Acquiring lock "cinder-150aedaf-467e-40f2-b98a-cc34f12791fc-delete_snapshot" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:35 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6f64893d-0dda-4c4a-9913-22addcf089e8 tempest-SnapshotDependencyTests-1591423573 None] Lock "cinder-150aedaf-467e-40f2-b98a-cc34f12791fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:35 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6f64893d-0dda-4c4a-9913-22addcf089e8 tempest-SnapshotDependencyTests-1591423573 None] Acquiring lock "cinder-quobyte-a5e67871-e782-40e6-8711-08bc89eb2cd1" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:35 devstack sudo[91750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144.d400cc92-d8d8-4e96-a072-daae94887187
Feb 28 04:50:35 devstack sudo[91750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:35 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6f64893d-0dda-4c4a-9913-22addcf089e8 tempest-SnapshotDependencyTests-1591423573 None] Lock "cinder-quobyte-a5e67871-e782-40e6-8711-08bc89eb2cd1" acquired by "delete_snapshot" :: waited 0.007s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:35 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6f64893d-0dda-4c4a-9913-22addcf089e8 tempest-SnapshotDependencyTests-1591423573 None] Acquiring lock "cinder-quobyte-150aedaf-467e-40f2-b98a-cc34f12791fc" by "_delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:35 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6f64893d-0dda-4c4a-9913-22addcf089e8 tempest-SnapshotDependencyTests-1591423573 None] Lock "cinder-quobyte-150aedaf-467e-40f2-b98a-cc34f12791fc" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:35 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-6f64893d-0dda-4c4a-9913-22addcf089e8 tempest-SnapshotDependencyTests-1591423573 None] Deleting offline snapshot 150aedaf-467e-40f2-b98a-cc34f12791fc of volume a5e67871-e782-40e6-8711-08bc89eb2cd1 {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 04:50:35 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-6f64893d-0dda-4c4a-9913-22addcf089e8 tempest-SnapshotDependencyTests-1591423573 None] snapshot_file for this snap is: volume-a5e67871-e782-40e6-8711-08bc89eb2cd1.150aedaf-467e-40f2-b98a-cc34f12791fc {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 04:50:35 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8a7c0b-a976-4c0b-b4ec-ca635066d891]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:35 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6f64893d-0dda-4c4a-9913-22addcf089e8 tempest-SnapshotDependencyTests-1591423573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1.150aedaf-467e-40f2-b98a-cc34f12791fc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:35 devstack sudo[91752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1.150aedaf-467e-40f2-b98a-cc34f12791fc
Feb 28 04:50:35 devstack sudo[91752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:36 devstack sudo[91748]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d2b79dda-ce56-49fe-a063-e4fcacf30dbd tempest-CinderUnicodeTest-1234426951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1" returned: 0 in 0.536s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d2b79dda-ce56-49fe-a063-e4fcacf30dbd tempest-CinderUnicodeTest-1234426951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1.06282d50-ac19-4a67-94fb-04f7e374b20f 1G {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:36 devstack sudo[91757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1.06282d50-ac19-4a67-94fb-04f7e374b20f 1G
Feb 28 04:50:36 devstack sudo[91757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:36 devstack sudo[91750]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-56d59fcb-0b79-4759-94dd-430ae2c6b10b tempest-CreateVolumesFromSnapshotTest-1134726136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144.d400cc92-d8d8-4e96-a072-daae94887187" returned: 0 in 0.495s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:36 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-56d59fcb-0b79-4759-94dd-430ae2c6b10b tempest-CreateVolumesFromSnapshotTest-1134726136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73d57c89-7228-43e4-ae94-e3cc2e050144(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:50:36 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7f3187-b080-447a-bad0-105423115ce3]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-56d59fcb-0b79-4759-94dd-430ae2c6b10b tempest-CreateVolumesFromSnapshotTest-1134726136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:36 devstack sudo[91763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144
Feb 28 04:50:36 devstack sudo[91763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:36 devstack sudo[91752]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6f64893d-0dda-4c4a-9913-22addcf089e8 tempest-SnapshotDependencyTests-1591423573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1.150aedaf-467e-40f2-b98a-cc34f12791fc" returned: 0 in 0.476s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:36 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-6f64893d-0dda-4c4a-9913-22addcf089e8 tempest-SnapshotDependencyTests-1591423573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5e67871-e782-40e6-8711-08bc89eb2cd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:50:36 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81ae906-af5e-419a-befa-a94a09cb3db8]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6f64893d-0dda-4c4a-9913-22addcf089e8 tempest-SnapshotDependencyTests-1591423573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:36 devstack sudo[91767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1
Feb 28 04:50:36 devstack sudo[91767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:36 devstack sudo[91757]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d2b79dda-ce56-49fe-a063-e4fcacf30dbd tempest-CinderUnicodeTest-1234426951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1.06282d50-ac19-4a67-94fb-04f7e374b20f 1G" returned: 0 in 0.474s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d2b79dda-ce56-49fe-a063-e4fcacf30dbd tempest-CinderUnicodeTest-1234426951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61f4e332-dc2a-450e-8005-99a99f5d25a1 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1.06282d50-ac19-4a67-94fb-04f7e374b20f {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:36 devstack sudo[91772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61f4e332-dc2a-450e-8005-99a99f5d25a1 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1.06282d50-ac19-4a67-94fb-04f7e374b20f
Feb 28 04:50:36 devstack sudo[91772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:36 devstack sudo[91763]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-56d59fcb-0b79-4759-94dd-430ae2c6b10b tempest-CreateVolumesFromSnapshotTest-1134726136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144" returned: 0 in 0.485s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-56d59fcb-0b79-4759-94dd-430ae2c6b10b tempest-CreateVolumesFromSnapshotTest-1134726136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144.d400cc92-d8d8-4e96-a072-daae94887187 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:36 devstack sudo[91778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144.d400cc92-d8d8-4e96-a072-daae94887187
Feb 28 04:50:36 devstack sudo[91778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:36 devstack sudo[91767]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6f64893d-0dda-4c4a-9913-22addcf089e8 tempest-SnapshotDependencyTests-1591423573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1" returned: 0 in 0.475s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6f64893d-0dda-4c4a-9913-22addcf089e8 tempest-SnapshotDependencyTests-1591423573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1.150aedaf-467e-40f2-b98a-cc34f12791fc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:36 devstack sudo[91782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1.150aedaf-467e-40f2-b98a-cc34f12791fc
Feb 28 04:50:36 devstack sudo[91782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:36 devstack sudo[91772]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d2b79dda-ce56-49fe-a063-e4fcacf30dbd tempest-CinderUnicodeTest-1234426951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61f4e332-dc2a-450e-8005-99a99f5d25a1 -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1.06282d50-ac19-4a67-94fb-04f7e374b20f" returned: 0 in 0.443s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:36 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-d2b79dda-ce56-49fe-a063-e4fcacf30dbd tempest-CinderUnicodeTest-1234426951 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1.06282d50-ac19-4a67-94fb-04f7e374b20f is being set with open permissions: ugo+rw
Feb 28 04:50:36 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d2b79dda-ce56-49fe-a063-e4fcacf30dbd tempest-CinderUnicodeTest-1234426951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1.06282d50-ac19-4a67-94fb-04f7e374b20f {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:36 devstack sudo[91787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1.06282d50-ac19-4a67-94fb-04f7e374b20f
Feb 28 04:50:36 devstack sudo[91787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:37 devstack sudo[91778]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-56d59fcb-0b79-4759-94dd-430ae2c6b10b tempest-CreateVolumesFromSnapshotTest-1134726136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144.d400cc92-d8d8-4e96-a072-daae94887187" returned: 0 in 0.476s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-56d59fcb-0b79-4759-94dd-430ae2c6b10b tempest-CreateVolumesFromSnapshotTest-1134726136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144.d400cc92-d8d8-4e96-a072-daae94887187 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:37 devstack sudo[91795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144.d400cc92-d8d8-4e96-a072-daae94887187
Feb 28 04:50:37 devstack sudo[91795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:37 devstack sudo[91782]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6f64893d-0dda-4c4a-9913-22addcf089e8 tempest-SnapshotDependencyTests-1591423573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1.150aedaf-467e-40f2-b98a-cc34f12791fc" returned: 0 in 0.439s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6f64893d-0dda-4c4a-9913-22addcf089e8 tempest-SnapshotDependencyTests-1591423573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1.150aedaf-467e-40f2-b98a-cc34f12791fc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:37 devstack sudo[91797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1.150aedaf-467e-40f2-b98a-cc34f12791fc
Feb 28 04:50:37 devstack sudo[91797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:37 devstack sudo[91787]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d2b79dda-ce56-49fe-a063-e4fcacf30dbd tempest-CinderUnicodeTest-1234426951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1.06282d50-ac19-4a67-94fb-04f7e374b20f" returned: 0 in 0.435s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d2b79dda-ce56-49fe-a063-e4fcacf30dbd tempest-CinderUnicodeTest-1234426951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:37 devstack sudo[91800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1.info
Feb 28 04:50:37 devstack sudo[91800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:37 devstack sudo[91795]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-56d59fcb-0b79-4759-94dd-430ae2c6b10b tempest-CreateVolumesFromSnapshotTest-1134726136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144.d400cc92-d8d8-4e96-a072-daae94887187" returned: 0 in 0.391s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:37 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-56d59fcb-0b79-4759-94dd-430ae2c6b10b tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "cinder-quobyte-d400cc92-d8d8-4e96-a072-daae94887187" released by "_delete_snapshot" :: held 1.915s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:37 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-56d59fcb-0b79-4759-94dd-430ae2c6b10b tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "cinder-quobyte-73d57c89-7228-43e4-ae94-e3cc2e050144" released by "delete_snapshot" :: held 1.929s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:37 devstack sudo[91797]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-6f64893d-0dda-4c4a-9913-22addcf089e8 tempest-SnapshotDependencyTests-1591423573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1.150aedaf-467e-40f2-b98a-cc34f12791fc" returned: 0 in 0.391s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:37 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-56d59fcb-0b79-4759-94dd-430ae2c6b10b tempest-CreateVolumesFromSnapshotTest-1134726136 None] Created reservations ['12197454-8168-4546-98ea-dad08dddb6e5', 'c0ce6ba9-5fdd-406a-a520-de041469a6ca', 'aa3ff9f6-1759-422e-a354-2cabcefe8ad8', '07a3ff95-4a19-4619-a002-76d8eef0089e'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:50:37 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6f64893d-0dda-4c4a-9913-22addcf089e8 tempest-SnapshotDependencyTests-1591423573 None] Lock "cinder-quobyte-150aedaf-467e-40f2-b98a-cc34f12791fc" released by "_delete_snapshot" :: held 1.845s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:37 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6f64893d-0dda-4c4a-9913-22addcf089e8 tempest-SnapshotDependencyTests-1591423573 None] Lock "cinder-quobyte-a5e67871-e782-40e6-8711-08bc89eb2cd1" released by "delete_snapshot" :: held 1.861s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:37 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-56d59fcb-0b79-4759-94dd-430ae2c6b10b tempest-CreateVolumesFromSnapshotTest-1134726136 None] Delete snapshot completed successfully.
Feb 28 04:50:37 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-6f64893d-0dda-4c4a-9913-22addcf089e8 tempest-SnapshotDependencyTests-1591423573 None] Created reservations ['83dd20df-d93f-429f-9254-44d2785f02a3', 'b4243649-3625-47b7-a3fc-bbfff7b45aad', '241cb3af-f148-41f1-ba0e-61dce37e2988', '68f28e04-a302-4edb-be93-9ec9b27ac949'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:50:37 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-56d59fcb-0b79-4759-94dd-430ae2c6b10b tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "cinder-d400cc92-d8d8-4e96-a072-daae94887187-delete_snapshot" released by "delete_snapshot" :: held 2.085s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:37 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-6f64893d-0dda-4c4a-9913-22addcf089e8 tempest-SnapshotDependencyTests-1591423573 None] Delete snapshot completed successfully.
Feb 28 04:50:37 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-6f64893d-0dda-4c4a-9913-22addcf089e8 tempest-SnapshotDependencyTests-1591423573 None] Lock "cinder-150aedaf-467e-40f2-b98a-cc34f12791fc-delete_snapshot" released by "delete_snapshot" :: held 1.961s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:37 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8b05c3d4-17ff-4c73-9144-5bf5230e191f tempest-CreateVolumesFromSnapshotTest-1134726136 None] Acquiring lock "cinder-73d57c89-7228-43e4-ae94-e3cc2e050144-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:37 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8b05c3d4-17ff-4c73-9144-5bf5230e191f tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "cinder-73d57c89-7228-43e4-ae94-e3cc2e050144-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:37 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8b05c3d4-17ff-4c73-9144-5bf5230e191f tempest-CreateVolumesFromSnapshotTest-1134726136 None] Acquiring lock "cinder-quobyte-73d57c89-7228-43e4-ae94-e3cc2e050144" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:37 devstack sudo[91800]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d2b79dda-ce56-49fe-a063-e4fcacf30dbd tempest-CinderUnicodeTest-1234426951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1.info" returned: 0 in 0.420s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:37 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-d2b79dda-ce56-49fe-a063-e4fcacf30dbd tempest-CinderUnicodeTest-1234426951 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1.info is being set with open permissions: ugo+rw
Feb 28 04:50:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d2b79dda-ce56-49fe-a063-e4fcacf30dbd tempest-CinderUnicodeTest-1234426951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:37 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8b05c3d4-17ff-4c73-9144-5bf5230e191f tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "cinder-quobyte-73d57c89-7228-43e4-ae94-e3cc2e050144" acquired by "delete_volume" :: waited 0.019s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:37 devstack sudo[91805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1.info
Feb 28 04:50:37 devstack sudo[91805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:37 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0215271-2230-4296-8924-697edc8c4b6f]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8b05c3d4-17ff-4c73-9144-5bf5230e191f tempest-CreateVolumesFromSnapshotTest-1134726136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:37 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-3193b72b-a809-4cf0-abaf-901d3113f2ae tempest-SnapshotDependencyTests-1591423573 None] Acquiring lock "cinder-a5e67871-e782-40e6-8711-08bc89eb2cd1-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:37 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-3193b72b-a809-4cf0-abaf-901d3113f2ae tempest-SnapshotDependencyTests-1591423573 None] Lock "cinder-a5e67871-e782-40e6-8711-08bc89eb2cd1-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:37 devstack sudo[91807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144
Feb 28 04:50:37 devstack sudo[91807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:37 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-3193b72b-a809-4cf0-abaf-901d3113f2ae tempest-SnapshotDependencyTests-1591423573 None] Acquiring lock "cinder-quobyte-a5e67871-e782-40e6-8711-08bc89eb2cd1" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:37 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-3193b72b-a809-4cf0-abaf-901d3113f2ae tempest-SnapshotDependencyTests-1591423573 None] Lock "cinder-quobyte-a5e67871-e782-40e6-8711-08bc89eb2cd1" acquired by "delete_volume" :: waited 0.006s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:37 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[03107eb1-cba7-459a-a75f-f5a7c4272dc2]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:37 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3193b72b-a809-4cf0-abaf-901d3113f2ae tempest-SnapshotDependencyTests-1591423573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:38 devstack sudo[91809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1
Feb 28 04:50:38 devstack sudo[91809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:38 devstack sudo[91805]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d2b79dda-ce56-49fe-a063-e4fcacf30dbd tempest-CinderUnicodeTest-1234426951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1.info" returned: 0 in 0.436s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d2b79dda-ce56-49fe-a063-e4fcacf30dbd tempest-CinderUnicodeTest-1234426951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.819s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 6.514s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:38 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Cloning volume e0a6fda7-1a49-497b-b913-d3e61e68d96e to volume 77a601ea-3219-440c-bf88-7c98ae15d303
Feb 28 04:50:38 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-d2b79dda-ce56-49fe-a063-e4fcacf30dbd tempest-CinderUnicodeTest-1234426951 None] Create snapshot completed successfully
Feb 28 04:50:38 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Creating offline snapshot 81feed18-7619-4a99-9f1a-f800a5086464 of volume e0a6fda7-1a49-497b-b913-d3e61e68d96e {{(pid=84248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 04:50:38 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67a20e4-d894-46ad-8ef8-c33730f0479d]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:38 devstack sudo[91807]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8b05c3d4-17ff-4c73-9144-5bf5230e191f tempest-CreateVolumesFromSnapshotTest-1134726136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144" returned: 0 in 0.508s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8b05c3d4-17ff-4c73-9144-5bf5230e191f tempest-CreateVolumesFromSnapshotTest-1134726136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:38 devstack sudo[91815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e
Feb 28 04:50:38 devstack sudo[91815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:38 devstack sudo[91816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144
Feb 28 04:50:38 devstack sudo[91816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:38 devstack sudo[91809]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3193b72b-a809-4cf0-abaf-901d3113f2ae tempest-SnapshotDependencyTests-1591423573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1" returned: 0 in 0.495s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3193b72b-a809-4cf0-abaf-901d3113f2ae tempest-SnapshotDependencyTests-1591423573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:38 devstack sudo[91822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1
Feb 28 04:50:38 devstack sudo[91822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:38 devstack sudo[91816]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8b05c3d4-17ff-4c73-9144-5bf5230e191f tempest-CreateVolumesFromSnapshotTest-1134726136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-73d57c89-7228-43e4-ae94-e3cc2e050144" returned: 0 in 0.413s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:38 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8b05c3d4-17ff-4c73-9144-5bf5230e191f tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "cinder-quobyte-73d57c89-7228-43e4-ae94-e3cc2e050144" released by "delete_volume" :: held 0.963s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:38 devstack sudo[91815]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e" returned: 0 in 0.488s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e.81feed18-7619-4a99-9f1a-f800a5086464 1G {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:38 devstack sudo[91829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e.81feed18-7619-4a99-9f1a-f800a5086464 1G
Feb 28 04:50:38 devstack sudo[91829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:38 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-8b05c3d4-17ff-4c73-9144-5bf5230e191f tempest-CreateVolumesFromSnapshotTest-1134726136 None] Created reservations ['c6f4714a-c12f-47d6-b8c6-5b34d4a675e1', '425e3511-8e01-4448-ab84-98be3d54ce58', '51225db1-ba17-4208-9713-cc08a74d1537', '6bc995a2-17f9-4d0c-b8e5-f6a6e08df720'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:50:38 devstack sudo[91822]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3193b72b-a809-4cf0-abaf-901d3113f2ae tempest-SnapshotDependencyTests-1591423573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-a5e67871-e782-40e6-8711-08bc89eb2cd1" returned: 0 in 0.424s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:38 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-3193b72b-a809-4cf0-abaf-901d3113f2ae tempest-SnapshotDependencyTests-1591423573 None] Lock "cinder-quobyte-a5e67871-e782-40e6-8711-08bc89eb2cd1" released by "delete_volume" :: held 0.978s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-8b05c3d4-17ff-4c73-9144-5bf5230e191f tempest-CreateVolumesFromSnapshotTest-1134726136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-8b05c3d4-17ff-4c73-9144-5bf5230e191f tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:38 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-8b05c3d4-17ff-4c73-9144-5bf5230e191f tempest-CreateVolumesFromSnapshotTest-1134726136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:38 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-8b05c3d4-17ff-4c73-9144-5bf5230e191f tempest-CreateVolumesFromSnapshotTest-1134726136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-8b05c3d4-17ff-4c73-9144-5bf5230e191f tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:38 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8b05c3d4-17ff-4c73-9144-5bf5230e191f tempest-CreateVolumesFromSnapshotTest-1134726136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:39 devstack sudo[91831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:50:39 devstack sudo[91831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:39 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f30d3b19-8aa8-4482-8d0f-4fabf01e8207 tempest-CinderUnicodeTest-1234426951 None] Acquiring lock "cinder-06282d50-ac19-4a67-94fb-04f7e374b20f-delete_snapshot" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:39 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f30d3b19-8aa8-4482-8d0f-4fabf01e8207 tempest-CinderUnicodeTest-1234426951 None] Lock "cinder-06282d50-ac19-4a67-94fb-04f7e374b20f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:39 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f30d3b19-8aa8-4482-8d0f-4fabf01e8207 tempest-CinderUnicodeTest-1234426951 None] Acquiring lock "cinder-quobyte-61f4e332-dc2a-450e-8005-99a99f5d25a1" by "delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:39 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-3193b72b-a809-4cf0-abaf-901d3113f2ae tempest-SnapshotDependencyTests-1591423573 None] Created reservations ['416ec020-2777-4450-98d4-a4ebb426248e', 'c15a6f23-aac3-42c8-a0b9-9e612a082dae', 'a1fe4b34-0a4d-4112-9b80-5cec8ed2114f', '528bda41-b92d-40bb-9df3-36e96b4550c7'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:50:39 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f30d3b19-8aa8-4482-8d0f-4fabf01e8207 tempest-CinderUnicodeTest-1234426951 None] Lock "cinder-quobyte-61f4e332-dc2a-450e-8005-99a99f5d25a1" acquired by "delete_snapshot" :: waited 0.027s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:39 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f30d3b19-8aa8-4482-8d0f-4fabf01e8207 tempest-CinderUnicodeTest-1234426951 None] Acquiring lock "cinder-quobyte-06282d50-ac19-4a67-94fb-04f7e374b20f" by "_delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:39 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f30d3b19-8aa8-4482-8d0f-4fabf01e8207 tempest-CinderUnicodeTest-1234426951 None] Lock "cinder-quobyte-06282d50-ac19-4a67-94fb-04f7e374b20f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:39 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-f30d3b19-8aa8-4482-8d0f-4fabf01e8207 tempest-CinderUnicodeTest-1234426951 None] Deleting offline snapshot 06282d50-ac19-4a67-94fb-04f7e374b20f of volume 61f4e332-dc2a-450e-8005-99a99f5d25a1 {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 04:50:39 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-f30d3b19-8aa8-4482-8d0f-4fabf01e8207 tempest-CinderUnicodeTest-1234426951 None] snapshot_file for this snap is: volume-61f4e332-dc2a-450e-8005-99a99f5d25a1.06282d50-ac19-4a67-94fb-04f7e374b20f {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 04:50:39 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aed7fa0-1473-4ef3-b665-374b15d87724]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f30d3b19-8aa8-4482-8d0f-4fabf01e8207 tempest-CinderUnicodeTest-1234426951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1.06282d50-ac19-4a67-94fb-04f7e374b20f {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3193b72b-a809-4cf0-abaf-901d3113f2ae tempest-SnapshotDependencyTests-1591423573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3193b72b-a809-4cf0-abaf-901d3113f2ae tempest-SnapshotDependencyTests-1591423573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:39 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-3193b72b-a809-4cf0-abaf-901d3113f2ae tempest-SnapshotDependencyTests-1591423573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:39 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-3193b72b-a809-4cf0-abaf-901d3113f2ae tempest-SnapshotDependencyTests-1591423573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3193b72b-a809-4cf0-abaf-901d3113f2ae tempest-SnapshotDependencyTests-1591423573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3193b72b-a809-4cf0-abaf-901d3113f2ae tempest-SnapshotDependencyTests-1591423573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:39 devstack sudo[91834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:50:39 devstack sudo[91834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:39 devstack sudo[91833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1.06282d50-ac19-4a67-94fb-04f7e374b20f
Feb 28 04:50:39 devstack sudo[91833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:39 devstack sudo[91829]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e.81feed18-7619-4a99-9f1a-f800a5086464 1G" returned: 0 in 0.556s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e.81feed18-7619-4a99-9f1a-f800a5086464 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:39 devstack sudo[91840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e.81feed18-7619-4a99-9f1a-f800a5086464
Feb 28 04:50:39 devstack sudo[91840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:39 devstack sudo[91831]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8b05c3d4-17ff-4c73-9144-5bf5230e191f tempest-CreateVolumesFromSnapshotTest-1134726136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.606s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:39 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-8b05c3d4-17ff-4c73-9144-5bf5230e191f tempest-CreateVolumesFromSnapshotTest-1134726136 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:50:39 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-8b05c3d4-17ff-4c73-9144-5bf5230e191f tempest-CreateVolumesFromSnapshotTest-1134726136 None] Deleted volume successfully.
Feb 28 04:50:39 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8b05c3d4-17ff-4c73-9144-5bf5230e191f tempest-CreateVolumesFromSnapshotTest-1134726136 None] Lock "cinder-73d57c89-7228-43e4-ae94-e3cc2e050144-delete_volume" released by "delete_volume" :: held 1.817s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:39 devstack sudo[91834]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3193b72b-a809-4cf0-abaf-901d3113f2ae tempest-SnapshotDependencyTests-1591423573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.546s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:39 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-3193b72b-a809-4cf0-abaf-901d3113f2ae tempest-SnapshotDependencyTests-1591423573 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:50:39 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-3193b72b-a809-4cf0-abaf-901d3113f2ae tempest-SnapshotDependencyTests-1591423573 None] Deleted volume successfully.
Feb 28 04:50:39 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-3193b72b-a809-4cf0-abaf-901d3113f2ae tempest-SnapshotDependencyTests-1591423573 None] Lock "cinder-a5e67871-e782-40e6-8711-08bc89eb2cd1-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:39 devstack sudo[91833]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f30d3b19-8aa8-4482-8d0f-4fabf01e8207 tempest-CinderUnicodeTest-1234426951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1.06282d50-ac19-4a67-94fb-04f7e374b20f" returned: 0 in 0.641s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:39 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-f30d3b19-8aa8-4482-8d0f-4fabf01e8207 tempest-CinderUnicodeTest-1234426951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61f4e332-dc2a-450e-8005-99a99f5d25a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:50:39 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffb9109-db38-49c1-ba8f-9f13e6b646e2]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f30d3b19-8aa8-4482-8d0f-4fabf01e8207 tempest-CinderUnicodeTest-1234426951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:39 devstack sudo[91847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1
Feb 28 04:50:39 devstack sudo[91847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:39 devstack sudo[91840]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e -F qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e.81feed18-7619-4a99-9f1a-f800a5086464" returned: 0 in 0.613s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:39 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e.81feed18-7619-4a99-9f1a-f800a5086464 is being set with open permissions: ugo+rw
Feb 28 04:50:39 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e.81feed18-7619-4a99-9f1a-f800a5086464 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:39 devstack sudo[91853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e.81feed18-7619-4a99-9f1a-f800a5086464
Feb 28 04:50:39 devstack sudo[91853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:40 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d5250f3c-3f33-4f4d-844f-7b7df4b35337 tempest-SnapshotDependencyTests-1591423573 None] Acquiring lock "cinder-b6f0320c-dbe9-454d-9692-0004d0337125-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:40 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d5250f3c-3f33-4f4d-844f-7b7df4b35337 tempest-SnapshotDependencyTests-1591423573 None] Lock "cinder-b6f0320c-dbe9-454d-9692-0004d0337125-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:40 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d5250f3c-3f33-4f4d-844f-7b7df4b35337 tempest-SnapshotDependencyTests-1591423573 None] Acquiring lock "cinder-quobyte-b6f0320c-dbe9-454d-9692-0004d0337125" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:40 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d5250f3c-3f33-4f4d-844f-7b7df4b35337 tempest-SnapshotDependencyTests-1591423573 None] Lock "cinder-quobyte-b6f0320c-dbe9-454d-9692-0004d0337125" acquired by "delete_volume" :: waited 0.017s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:40 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb1bc58-f1cc-42af-b0c6-9bb49eef24c8]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d5250f3c-3f33-4f4d-844f-7b7df4b35337 tempest-SnapshotDependencyTests-1591423573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b6f0320c-dbe9-454d-9692-0004d0337125 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:40 devstack sudo[91847]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f30d3b19-8aa8-4482-8d0f-4fabf01e8207 tempest-CinderUnicodeTest-1234426951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1" returned: 0 in 0.545s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f30d3b19-8aa8-4482-8d0f-4fabf01e8207 tempest-CinderUnicodeTest-1234426951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1.06282d50-ac19-4a67-94fb-04f7e374b20f {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:40 devstack sudo[91859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1.06282d50-ac19-4a67-94fb-04f7e374b20f
Feb 28 04:50:40 devstack sudo[91859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:40 devstack sudo[91858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b6f0320c-dbe9-454d-9692-0004d0337125
Feb 28 04:50:40 devstack sudo[91858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:40 devstack sudo[91853]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e.81feed18-7619-4a99-9f1a-f800a5086464" returned: 0 in 0.452s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:40 devstack sudo[91863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e.info
Feb 28 04:50:40 devstack sudo[91863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:40 devstack sudo[91858]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d5250f3c-3f33-4f4d-844f-7b7df4b35337 tempest-SnapshotDependencyTests-1591423573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b6f0320c-dbe9-454d-9692-0004d0337125" returned: 0 in 0.515s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d5250f3c-3f33-4f4d-844f-7b7df4b35337 tempest-SnapshotDependencyTests-1591423573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b6f0320c-dbe9-454d-9692-0004d0337125 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:40 devstack sudo[91871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b6f0320c-dbe9-454d-9692-0004d0337125
Feb 28 04:50:40 devstack sudo[91871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:40 devstack sudo[91859]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f30d3b19-8aa8-4482-8d0f-4fabf01e8207 tempest-CinderUnicodeTest-1234426951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1.06282d50-ac19-4a67-94fb-04f7e374b20f" returned: 0 in 0.525s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f30d3b19-8aa8-4482-8d0f-4fabf01e8207 tempest-CinderUnicodeTest-1234426951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1.06282d50-ac19-4a67-94fb-04f7e374b20f {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:40 devstack sudo[91873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1.06282d50-ac19-4a67-94fb-04f7e374b20f
Feb 28 04:50:40 devstack sudo[91873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:40 devstack sudo[91863]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e.info" returned: 0 in 0.492s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:40 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e.info is being set with open permissions: ugo+rw
Feb 28 04:50:40 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e.info {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:40 devstack sudo[91876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e.info
Feb 28 04:50:40 devstack sudo[91876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:41 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b99d23a-0e6a-4215-9f4e-a91e53d8bd2e tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:50:41 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-2b99d23a-0e6a-4215-9f4e-a91e53d8bd2e tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Flow 'volume_create_manager' (68af37fd-921e-40f2-ad34-5de66485912f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:41 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-2b99d23a-0e6a-4215-9f4e-a91e53d8bd2e tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77fc2134-0358-498b-9436-a0f54eb0c3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:41 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-2b99d23a-0e6a-4215-9f4e-a91e53d8bd2e tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77fc2134-0358-498b-9436-a0f54eb0c3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-584952848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4de51be4-5ab8-4a0c-bbc2-c0da8954c435,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f2aa563dc3748f39a665a296ede003b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:41Z,use_quota=True,user_id='8091c8456908436496de23c84eada06e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:41 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-2b99d23a-0e6a-4215-9f4e-a91e53d8bd2e tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (507f5e09-d11b-467b-9902-56788549ea40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:41 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-2b99d23a-0e6a-4215-9f4e-a91e53d8bd2e tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (507f5e09-d11b-467b-9902-56788549ea40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:41 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-2b99d23a-0e6a-4215-9f4e-a91e53d8bd2e tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d498ec58-22f5-4512-a3cd-36a99902841d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:41 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-2b99d23a-0e6a-4215-9f4e-a91e53d8bd2e tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d498ec58-22f5-4512-a3cd-36a99902841d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4de51be4-5ab8-4a0c-bbc2-c0da8954c435', 'volume_name': 'volume-4de51be4-5ab8-4a0c-bbc2-c0da8954c435', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:41 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-2b99d23a-0e6a-4215-9f4e-a91e53d8bd2e tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (733ab5d4-db0c-42b1-84ab-7dcac913efea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:41 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-2b99d23a-0e6a-4215-9f4e-a91e53d8bd2e tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (733ab5d4-db0c-42b1-84ab-7dcac913efea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:41 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-2b99d23a-0e6a-4215-9f4e-a91e53d8bd2e tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b3ba467-8710-4776-b8c9-e0b1346c0f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:41 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-2b99d23a-0e6a-4215-9f4e-a91e53d8bd2e tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Volume 4de51be4-5ab8-4a0c-bbc2-c0da8954c435: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4de51be4-5ab8-4a0c-bbc2-c0da8954c435', 'volume_size': 1}
Feb 28 04:50:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-2b99d23a-0e6a-4215-9f4e-a91e53d8bd2e tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:41 devstack sudo[91871]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d5250f3c-3f33-4f4d-844f-7b7df4b35337 tempest-SnapshotDependencyTests-1591423573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-b6f0320c-dbe9-454d-9692-0004d0337125" returned: 0 in 0.448s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:41 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d5250f3c-3f33-4f4d-844f-7b7df4b35337 tempest-SnapshotDependencyTests-1591423573 None] Lock "cinder-quobyte-b6f0320c-dbe9-454d-9692-0004d0337125" released by "delete_volume" :: held 0.997s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:41 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-d5250f3c-3f33-4f4d-844f-7b7df4b35337 tempest-SnapshotDependencyTests-1591423573 None] Created reservations ['491a836b-fc6f-42c7-a3fc-98e28c5502f9', 'aab93719-d94f-4d5e-b6d6-f6c69b3b2c9e', '181ef776-6641-4aa3-9a73-64410fb6d4bd', '6e4f7edb-d965-4622-aff5-35e528fd21be'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:50:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d5250f3c-3f33-4f4d-844f-7b7df4b35337 tempest-SnapshotDependencyTests-1591423573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d5250f3c-3f33-4f4d-844f-7b7df4b35337 tempest-SnapshotDependencyTests-1591423573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:41 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-d5250f3c-3f33-4f4d-844f-7b7df4b35337 tempest-SnapshotDependencyTests-1591423573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:41 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-d5250f3c-3f33-4f4d-844f-7b7df4b35337 tempest-SnapshotDependencyTests-1591423573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-d5250f3c-3f33-4f4d-844f-7b7df4b35337 tempest-SnapshotDependencyTests-1591423573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d5250f3c-3f33-4f4d-844f-7b7df4b35337 tempest-SnapshotDependencyTests-1591423573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:41 devstack sudo[91873]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:41 devstack sudo[91881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:50:41 devstack sudo[91881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f30d3b19-8aa8-4482-8d0f-4fabf01e8207 tempest-CinderUnicodeTest-1234426951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1.06282d50-ac19-4a67-94fb-04f7e374b20f" returned: 0 in 0.537s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:41 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f30d3b19-8aa8-4482-8d0f-4fabf01e8207 tempest-CinderUnicodeTest-1234426951 None] Lock "cinder-quobyte-06282d50-ac19-4a67-94fb-04f7e374b20f" released by "_delete_snapshot" :: held 2.316s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:41 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f30d3b19-8aa8-4482-8d0f-4fabf01e8207 tempest-CinderUnicodeTest-1234426951 None] Lock "cinder-quobyte-61f4e332-dc2a-450e-8005-99a99f5d25a1" released by "delete_snapshot" :: held 2.341s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:41 devstack sudo[91876]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e.info" returned: 0 in 0.465s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:41 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Acquiring lock "cinder-quobyte-77a601ea-3219-440c-bf88-7c98ae15d303" by "_copy_volume_from_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:41 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Lock "cinder-quobyte-77a601ea-3219-440c-bf88-7c98ae15d303" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:41 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] snapshot: 81feed18-7619-4a99-9f1a-f800a5086464, volume: 77a601ea-3219-440c-bf88-7c98ae15d303,  {{(pid=84248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 28 04:50:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:41 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:41 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:41 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[b429c878-7236-43b9-9f2f-7ac3997a2a3b]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e.81feed18-7619-4a99-9f1a-f800a5086464 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:41 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-f30d3b19-8aa8-4482-8d0f-4fabf01e8207 tempest-CinderUnicodeTest-1234426951 None] Created reservations ['e0844be0-1220-4499-8621-6ce84a512df8', 'a68163ec-e3af-4935-8842-480e02710397', '369c1137-e353-4598-b429-b13eb1a87f89', '9510c5dd-a47c-4c1f-ac99-87dbc672eff6'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:50:41 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-f30d3b19-8aa8-4482-8d0f-4fabf01e8207 tempest-CinderUnicodeTest-1234426951 None] Delete snapshot completed successfully.
Feb 28 04:50:41 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f30d3b19-8aa8-4482-8d0f-4fabf01e8207 tempest-CinderUnicodeTest-1234426951 None] Lock "cinder-06282d50-ac19-4a67-94fb-04f7e374b20f-delete_snapshot" released by "delete_snapshot" :: held 2.487s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:41 devstack sudo[91883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e.81feed18-7619-4a99-9f1a-f800a5086464
Feb 28 04:50:41 devstack sudo[91883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:41 devstack sudo[91881]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-d5250f3c-3f33-4f4d-844f-7b7df4b35337 tempest-SnapshotDependencyTests-1591423573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.408s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:41 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-d5250f3c-3f33-4f4d-844f-7b7df4b35337 tempest-SnapshotDependencyTests-1591423573 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:50:41 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-d5250f3c-3f33-4f4d-844f-7b7df4b35337 tempest-SnapshotDependencyTests-1591423573 None] Deleted volume successfully.
Feb 28 04:50:41 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-d5250f3c-3f33-4f4d-844f-7b7df4b35337 tempest-SnapshotDependencyTests-1591423573 None] Lock "cinder-b6f0320c-dbe9-454d-9692-0004d0337125-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:41 devstack sudo[91883]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e.81feed18-7619-4a99-9f1a-f800a5086464" returned: 0 in 0.477s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:41 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:50:41 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] will copy from snapshot at /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e {{(pid=84248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 28 04:50:41 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Creating direct copy from snapshot {{(pid=84248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 28 04:50:41 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a01a6c-0ca9-4bb7-befe-17abea8e7665]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:41 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:42 devstack sudo[91889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e
Feb 28 04:50:42 devstack sudo[91889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:42 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f4f9d4aa-b28d-40e2-855b-c538db8b7e05 tempest-CinderUnicodeTest-1234426951 None] Acquiring lock "cinder-61f4e332-dc2a-450e-8005-99a99f5d25a1-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:42 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f4f9d4aa-b28d-40e2-855b-c538db8b7e05 tempest-CinderUnicodeTest-1234426951 None] Lock "cinder-61f4e332-dc2a-450e-8005-99a99f5d25a1-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:42 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f4f9d4aa-b28d-40e2-855b-c538db8b7e05 tempest-CinderUnicodeTest-1234426951 None] Acquiring lock "cinder-quobyte-61f4e332-dc2a-450e-8005-99a99f5d25a1" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:42 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f4f9d4aa-b28d-40e2-855b-c538db8b7e05 tempest-CinderUnicodeTest-1234426951 None] Lock "cinder-quobyte-61f4e332-dc2a-450e-8005-99a99f5d25a1" acquired by "delete_volume" :: waited 0.007s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:42 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e1a582-ffaa-4b23-b400-c1620481788e]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:42 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f4f9d4aa-b28d-40e2-855b-c538db8b7e05 tempest-CinderUnicodeTest-1234426951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:42 devstack sudo[91891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1
Feb 28 04:50:42 devstack sudo[91891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:42 devstack sudo[91889]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:42 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e" returned: 0 in 0.561s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:42 devstack cinder-volume[84248]: DEBUG cinder.utils [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Path /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-77a601ea-3219-440c-bf88-7c98ae15d303 not found in is_blk_device check {{(pid=84248) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 28 04:50:42 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-77a601ea-3219-440c-bf88-7c98ae15d303 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:42 devstack sudo[91896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-77a601ea-3219-440c-bf88-7c98ae15d303
Feb 28 04:50:42 devstack sudo[91896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:42 devstack sudo[91891]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:42 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f4f9d4aa-b28d-40e2-855b-c538db8b7e05 tempest-CinderUnicodeTest-1234426951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1" returned: 0 in 0.480s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:42 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f4f9d4aa-b28d-40e2-855b-c538db8b7e05 tempest-CinderUnicodeTest-1234426951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:42 devstack sudo[91901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1
Feb 28 04:50:42 devstack sudo[91901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:43 devstack sudo[91901]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:43 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f4f9d4aa-b28d-40e2-855b-c538db8b7e05 tempest-CinderUnicodeTest-1234426951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-61f4e332-dc2a-450e-8005-99a99f5d25a1" returned: 0 in 1.150s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:43 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f4f9d4aa-b28d-40e2-855b-c538db8b7e05 tempest-CinderUnicodeTest-1234426951 None] Lock "cinder-quobyte-61f4e332-dc2a-450e-8005-99a99f5d25a1" released by "delete_volume" :: held 1.668s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:43 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-f4f9d4aa-b28d-40e2-855b-c538db8b7e05 tempest-CinderUnicodeTest-1234426951 None] Created reservations ['c9082909-e8a5-4f57-89df-e96d47deb1bd', '3a955d1e-5595-43dc-a80c-27f9b062b2da', '2fc75c7d-3147-4af4-9be2-bcd92dae8b4b', '2079886a-9009-408a-b7fc-4a35e79d6c37'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:50:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-f4f9d4aa-b28d-40e2-855b-c538db8b7e05 tempest-CinderUnicodeTest-1234426951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-f4f9d4aa-b28d-40e2-855b-c538db8b7e05 tempest-CinderUnicodeTest-1234426951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:44 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-f4f9d4aa-b28d-40e2-855b-c538db8b7e05 tempest-CinderUnicodeTest-1234426951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:44 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-f4f9d4aa-b28d-40e2-855b-c538db8b7e05 tempest-CinderUnicodeTest-1234426951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-f4f9d4aa-b28d-40e2-855b-c538db8b7e05 tempest-CinderUnicodeTest-1234426951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f4f9d4aa-b28d-40e2-855b-c538db8b7e05 tempest-CinderUnicodeTest-1234426951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:44 devstack sudo[91914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:50:44 devstack sudo[91914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:44 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-e76cd7b3-0337-4b83-9775-1dda65f6bdaf tempest-CinderUnicodeTest-1234426951 None] Acquiring lock "cinder-9530667f-3750-4db5-a0df-202de6ba1cca-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:44 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-e76cd7b3-0337-4b83-9775-1dda65f6bdaf tempest-CinderUnicodeTest-1234426951 None] Lock "cinder-9530667f-3750-4db5-a0df-202de6ba1cca-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:44 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-e76cd7b3-0337-4b83-9775-1dda65f6bdaf tempest-CinderUnicodeTest-1234426951 None] Acquiring lock "cinder-quobyte-9530667f-3750-4db5-a0df-202de6ba1cca" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:44 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-e76cd7b3-0337-4b83-9775-1dda65f6bdaf tempest-CinderUnicodeTest-1234426951 None] Lock "cinder-quobyte-9530667f-3750-4db5-a0df-202de6ba1cca" acquired by "delete_volume" :: waited 0.008s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:44 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fab14b-2366-4122-b083-0782e8c13128]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e76cd7b3-0337-4b83-9775-1dda65f6bdaf tempest-CinderUnicodeTest-1234426951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9530667f-3750-4db5-a0df-202de6ba1cca {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:44 devstack sudo[91896]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-77a601ea-3219-440c-bf88-7c98ae15d303" returned: 0 in 2.320s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:44 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbfd19f5-333a-4fdc-886b-d40e721ae72c]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:44 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:44 devstack sudo[91918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9530667f-3750-4db5-a0df-202de6ba1cca
Feb 28 04:50:44 devstack sudo[91918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:44 devstack sudo[91919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e
Feb 28 04:50:44 devstack sudo[91919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:45 devstack sudo[91914]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-f4f9d4aa-b28d-40e2-855b-c538db8b7e05 tempest-CinderUnicodeTest-1234426951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.917s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:45 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-f4f9d4aa-b28d-40e2-855b-c538db8b7e05 tempest-CinderUnicodeTest-1234426951 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:50:45 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-f4f9d4aa-b28d-40e2-855b-c538db8b7e05 tempest-CinderUnicodeTest-1234426951 None] Deleted volume successfully.
Feb 28 04:50:45 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-f4f9d4aa-b28d-40e2-855b-c538db8b7e05 tempest-CinderUnicodeTest-1234426951 None] Lock "cinder-61f4e332-dc2a-450e-8005-99a99f5d25a1-delete_volume" released by "delete_volume" :: held 2.937s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:45 devstack sudo[91918]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e76cd7b3-0337-4b83-9775-1dda65f6bdaf tempest-CinderUnicodeTest-1234426951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9530667f-3750-4db5-a0df-202de6ba1cca" returned: 0 in 0.544s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e76cd7b3-0337-4b83-9775-1dda65f6bdaf tempest-CinderUnicodeTest-1234426951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9530667f-3750-4db5-a0df-202de6ba1cca {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:45 devstack sudo[91928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9530667f-3750-4db5-a0df-202de6ba1cca
Feb 28 04:50:45 devstack sudo[91928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:45 devstack sudo[91919]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e" returned: 0 in 0.654s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:45 devstack cinder-volume[84248]: DEBUG cinder.image.image_utils [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Image conversion details: src /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e, size 1024.00 MB, duration 2.32 sec, destination /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-77a601ea-3219-440c-bf88-7c98ae15d303 {{(pid=84248) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 28 04:50:45 devstack cinder-volume[84248]: INFO cinder.image.image_utils [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Converted 1024.00 MB image at 441.13 MB/s
Feb 28 04:50:45 devstack cinder-volume[84248]: WARNING cinder.volume.drivers.remotefs [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-77a601ea-3219-440c-bf88-7c98ae15d303 is being set with open permissions: ugo+rw
Feb 28 04:50:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-77a601ea-3219-440c-bf88-7c98ae15d303 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:45 devstack sudo[91931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-77a601ea-3219-440c-bf88-7c98ae15d303
Feb 28 04:50:45 devstack sudo[91931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:45 devstack sudo[91928]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e76cd7b3-0337-4b83-9775-1dda65f6bdaf tempest-CinderUnicodeTest-1234426951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-9530667f-3750-4db5-a0df-202de6ba1cca" returned: 0 in 0.480s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:45 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-e76cd7b3-0337-4b83-9775-1dda65f6bdaf tempest-CinderUnicodeTest-1234426951 None] Lock "cinder-quobyte-9530667f-3750-4db5-a0df-202de6ba1cca" released by "delete_volume" :: held 1.048s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:45 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-e76cd7b3-0337-4b83-9775-1dda65f6bdaf tempest-CinderUnicodeTest-1234426951 None] Created reservations ['563a7a98-f74e-4787-8302-5870923c525d', 'd2cb5a97-afc6-432d-a14d-bd78a7f576b8', '07365dfd-2ff0-47de-84a5-81f670f5165a', '606439f1-f139-4764-b820-01d635898d75'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:50:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e76cd7b3-0337-4b83-9775-1dda65f6bdaf tempest-CinderUnicodeTest-1234426951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e76cd7b3-0337-4b83-9775-1dda65f6bdaf tempest-CinderUnicodeTest-1234426951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:45 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-e76cd7b3-0337-4b83-9775-1dda65f6bdaf tempest-CinderUnicodeTest-1234426951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:45 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-e76cd7b3-0337-4b83-9775-1dda65f6bdaf tempest-CinderUnicodeTest-1234426951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-e76cd7b3-0337-4b83-9775-1dda65f6bdaf tempest-CinderUnicodeTest-1234426951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e76cd7b3-0337-4b83-9775-1dda65f6bdaf tempest-CinderUnicodeTest-1234426951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:45 devstack sudo[91935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:50:45 devstack sudo[91935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:45 devstack sudo[91931]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-77a601ea-3219-440c-bf88-7c98ae15d303" returned: 0 in 0.456s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:45 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Lock "cinder-quobyte-77a601ea-3219-440c-bf88-7c98ae15d303" released by "_copy_volume_from_snapshot" :: held 4.514s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:45 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Acquiring lock "cinder-quobyte-81feed18-7619-4a99-9f1a-f800a5086464" by "_delete_snapshot" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:45 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Lock "cinder-quobyte-81feed18-7619-4a99-9f1a-f800a5086464" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:45 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Deleting offline snapshot 81feed18-7619-4a99-9f1a-f800a5086464 of volume e0a6fda7-1a49-497b-b913-d3e61e68d96e {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 04:50:45 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] snapshot_file for this snap is: volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e.81feed18-7619-4a99-9f1a-f800a5086464 {{(pid=84248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 04:50:45 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[b711a364-977b-493b-af80-bb49aa028a47]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:45 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e.81feed18-7619-4a99-9f1a-f800a5086464 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:46 devstack sudo[91937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e.81feed18-7619-4a99-9f1a-f800a5086464
Feb 28 04:50:46 devstack sudo[91937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:46 devstack sudo[91935]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:46 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-e76cd7b3-0337-4b83-9775-1dda65f6bdaf tempest-CinderUnicodeTest-1234426951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.464s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:46 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-e76cd7b3-0337-4b83-9775-1dda65f6bdaf tempest-CinderUnicodeTest-1234426951 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:50:46 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-e76cd7b3-0337-4b83-9775-1dda65f6bdaf tempest-CinderUnicodeTest-1234426951 None] Deleted volume successfully.
Feb 28 04:50:46 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-e76cd7b3-0337-4b83-9775-1dda65f6bdaf tempest-CinderUnicodeTest-1234426951 None] Lock "cinder-9530667f-3750-4db5-a0df-202de6ba1cca-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:46 devstack sudo[91937]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:46 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e.81feed18-7619-4a99-9f1a-f800a5086464" returned: 0 in 0.541s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:46 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 04:50:46 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d0da83-e9ba-4593-8135-4a753edb18e7]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:46 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:46 devstack sudo[91944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e
Feb 28 04:50:46 devstack sudo[91944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:47 devstack sudo[91944]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:47 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e" returned: 0 in 0.533s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:47 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e.81feed18-7619-4a99-9f1a-f800a5086464 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:47 devstack sudo[91949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e.81feed18-7619-4a99-9f1a-f800a5086464
Feb 28 04:50:47 devstack sudo[91949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:47 devstack sudo[91949]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:47 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e.81feed18-7619-4a99-9f1a-f800a5086464" returned: 0 in 0.507s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:47 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e.81feed18-7619-4a99-9f1a-f800a5086464 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:47 devstack sudo[91955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e.81feed18-7619-4a99-9f1a-f800a5086464
Feb 28 04:50:47 devstack sudo[91955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:48 devstack sudo[91955]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:48 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e.81feed18-7619-4a99-9f1a-f800a5086464" returned: 0 in 0.458s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:48 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Lock "cinder-quobyte-81feed18-7619-4a99-9f1a-f800a5086464" released by "_delete_snapshot" :: held 2.095s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:48 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.821s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:48 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-2b99d23a-0e6a-4215-9f4e-a91e53d8bd2e tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.961s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:48 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-2b99d23a-0e6a-4215-9f4e-a91e53d8bd2e tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-584952848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4de51be4-5ab8-4a0c-bbc2-c0da8954c435,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f2aa563dc3748f39a665a296ede003b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:41Z,use_quota=True,user_id='8091c8456908436496de23c84eada06e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:50:48 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-2b99d23a-0e6a-4215-9f4e-a91e53d8bd2e tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Creating volume 4de51be4-5ab8-4a0c-bbc2-c0da8954c435 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:50:48 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-2b99d23a-0e6a-4215-9f4e-a91e53d8bd2e tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:48 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-2b99d23a-0e6a-4215-9f4e-a91e53d8bd2e tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:48 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-2b99d23a-0e6a-4215-9f4e-a91e53d8bd2e tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:48 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-2b99d23a-0e6a-4215-9f4e-a91e53d8bd2e tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:48 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-2b99d23a-0e6a-4215-9f4e-a91e53d8bd2e tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:48 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-2b99d23a-0e6a-4215-9f4e-a91e53d8bd2e tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:50:48 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-2b99d23a-0e6a-4215-9f4e-a91e53d8bd2e tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:50:48 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-2b99d23a-0e6a-4215-9f4e-a91e53d8bd2e tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4de51be4-5ab8-4a0c-bbc2-c0da8954c435 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:48 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1429f290-522f-43a0-8ecf-8b28076023ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77a601ea-3219-440c-bf88-7c98ae15d303', 'volume_size': 1, 'source_volid': 'e0a6fda7-1a49-497b-b913-d3e61e68d96e', 'source_volstatus': 'available'}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:48 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f66dfbcd-a2da-4785-9151-825d94251c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:48 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Volume volume-77a601ea-3219-440c-bf88-7c98ae15d303 (77a601ea-3219-440c-bf88-7c98ae15d303): created successfully
Feb 28 04:50:48 devstack sudo[91958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4de51be4-5ab8-4a0c-bbc2-c0da8954c435 1073741824
Feb 28 04:50:48 devstack sudo[91958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:48 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f66dfbcd-a2da-4785-9151-825d94251c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:48 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Flow 'volume_create_manager' (90172f5e-78cf-4285-b13f-2907a515c647) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:48 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-9bff4db0-e52a-47e0-881b-ceab6b308a5b tempest-VolumeDependencyTests-581964465 None] Created volume successfully.
Feb 28 04:50:48 devstack sudo[91958]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:48 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-2b99d23a-0e6a-4215-9f4e-a91e53d8bd2e tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4de51be4-5ab8-4a0c-bbc2-c0da8954c435 1073741824" returned: 0 in 0.529s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:48 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-2b99d23a-0e6a-4215-9f4e-a91e53d8bd2e tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4de51be4-5ab8-4a0c-bbc2-c0da8954c435 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:48 devstack sudo[91964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4de51be4-5ab8-4a0c-bbc2-c0da8954c435
Feb 28 04:50:48 devstack sudo[91964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:48 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-3026e411-61c9-4101-998e-9c51aee7d151 tempest-VolumeDependencyTests-581964465 None] Acquiring lock "cinder-e0a6fda7-1a49-497b-b913-d3e61e68d96e-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:48 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-3026e411-61c9-4101-998e-9c51aee7d151 tempest-VolumeDependencyTests-581964465 None] Lock "cinder-e0a6fda7-1a49-497b-b913-d3e61e68d96e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:48 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-3026e411-61c9-4101-998e-9c51aee7d151 tempest-VolumeDependencyTests-581964465 None] Acquiring lock "cinder-quobyte-e0a6fda7-1a49-497b-b913-d3e61e68d96e" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:48 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-3026e411-61c9-4101-998e-9c51aee7d151 tempest-VolumeDependencyTests-581964465 None] Lock "cinder-quobyte-e0a6fda7-1a49-497b-b913-d3e61e68d96e" acquired by "delete_volume" :: waited 0.010s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:48 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ae704b-f0a6-4856-bb6d-29d3b2782f4d]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:48 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3026e411-61c9-4101-998e-9c51aee7d151 tempest-VolumeDependencyTests-581964465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:49 devstack sudo[91966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e
Feb 28 04:50:49 devstack sudo[91966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:49 devstack sudo[91964]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-2b99d23a-0e6a-4215-9f4e-a91e53d8bd2e tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4de51be4-5ab8-4a0c-bbc2-c0da8954c435" returned: 0 in 0.434s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:49 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-2b99d23a-0e6a-4215-9f4e-a91e53d8bd2e tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:50:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-2b99d23a-0e6a-4215-9f4e-a91e53d8bd2e tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:49 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-2b99d23a-0e6a-4215-9f4e-a91e53d8bd2e tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b3ba467-8710-4776-b8c9-e0b1346c0f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4de51be4-5ab8-4a0c-bbc2-c0da8954c435', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:49 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-2b99d23a-0e6a-4215-9f4e-a91e53d8bd2e tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9912160d-e952-4326-a0da-010540da35b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:49 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-2b99d23a-0e6a-4215-9f4e-a91e53d8bd2e tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Volume volume-4de51be4-5ab8-4a0c-bbc2-c0da8954c435 (4de51be4-5ab8-4a0c-bbc2-c0da8954c435): created successfully
Feb 28 04:50:49 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-2b99d23a-0e6a-4215-9f4e-a91e53d8bd2e tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9912160d-e952-4326-a0da-010540da35b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:49 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-2b99d23a-0e6a-4215-9f4e-a91e53d8bd2e tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Flow 'volume_create_manager' (68af37fd-921e-40f2-ad34-5de66485912f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:49 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-2b99d23a-0e6a-4215-9f4e-a91e53d8bd2e tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Created volume successfully.
Feb 28 04:50:49 devstack sudo[91966]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3026e411-61c9-4101-998e-9c51aee7d151 tempest-VolumeDependencyTests-581964465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e" returned: 0 in 0.557s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3026e411-61c9-4101-998e-9c51aee7d151 tempest-VolumeDependencyTests-581964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:49 devstack sudo[91972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e
Feb 28 04:50:49 devstack sudo[91972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:49 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba7197ec-df05-407f-878b-a930c3d85867 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:50:49 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ba7197ec-df05-407f-878b-a930c3d85867 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Flow 'volume_create_manager' (8c7c0c70-d78c-4915-9aa1-afeefe66f0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:49 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ba7197ec-df05-407f-878b-a930c3d85867 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d4c3bd5-f86a-401d-8343-a3430f28b30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:49 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ba7197ec-df05-407f-878b-a930c3d85867 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d4c3bd5-f86a-401d-8343-a3430f28b30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1032635248',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df04dcbb-0e9c-4c55-ae52-2fcc74b7bace,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f2aa563dc3748f39a665a296ede003b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:50Z,use_quota=True,user_id='8091c8456908436496de23c84eada06e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:49 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ba7197ec-df05-407f-878b-a930c3d85867 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb8cc77d-2219-446a-a28a-12ad5e21571d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:49 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ba7197ec-df05-407f-878b-a930c3d85867 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb8cc77d-2219-446a-a28a-12ad5e21571d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:49 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ba7197ec-df05-407f-878b-a930c3d85867 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (335cc5c7-b49f-46e8-910a-0246b776bd06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:49 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ba7197ec-df05-407f-878b-a930c3d85867 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (335cc5c7-b49f-46e8-910a-0246b776bd06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df04dcbb-0e9c-4c55-ae52-2fcc74b7bace', 'volume_name': 'volume-df04dcbb-0e9c-4c55-ae52-2fcc74b7bace', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:49 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ba7197ec-df05-407f-878b-a930c3d85867 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (467db5c1-fcca-4088-a56f-e9aff0cc9de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:49 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ba7197ec-df05-407f-878b-a930c3d85867 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (467db5c1-fcca-4088-a56f-e9aff0cc9de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:49 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ba7197ec-df05-407f-878b-a930c3d85867 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11b30e49-8e82-4b66-88e1-4f27a1e2fa25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:49 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-ba7197ec-df05-407f-878b-a930c3d85867 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Volume df04dcbb-0e9c-4c55-ae52-2fcc74b7bace: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df04dcbb-0e9c-4c55-ae52-2fcc74b7bace', 'volume_size': 1}
Feb 28 04:50:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ba7197ec-df05-407f-878b-a930c3d85867 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ba7197ec-df05-407f-878b-a930c3d85867 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:49 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-ba7197ec-df05-407f-878b-a930c3d85867 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1032635248',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df04dcbb-0e9c-4c55-ae52-2fcc74b7bace,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f2aa563dc3748f39a665a296ede003b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:50Z,use_quota=True,user_id='8091c8456908436496de23c84eada06e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:50:49 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-ba7197ec-df05-407f-878b-a930c3d85867 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Creating volume df04dcbb-0e9c-4c55-ae52-2fcc74b7bace {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:50:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ba7197ec-df05-407f-878b-a930c3d85867 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ba7197ec-df05-407f-878b-a930c3d85867 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:49 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-ba7197ec-df05-407f-878b-a930c3d85867 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:49 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-ba7197ec-df05-407f-878b-a930c3d85867 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ba7197ec-df05-407f-878b-a930c3d85867 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:49 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-ba7197ec-df05-407f-878b-a930c3d85867 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:50:49 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-ba7197ec-df05-407f-878b-a930c3d85867 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:50:49 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ba7197ec-df05-407f-878b-a930c3d85867 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-df04dcbb-0e9c-4c55-ae52-2fcc74b7bace 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:49 devstack sudo[91975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-df04dcbb-0e9c-4c55-ae52-2fcc74b7bace 1073741824
Feb 28 04:50:49 devstack sudo[91975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a0b6f8b-f7e9-4924-97b4-f2a86a4249a1 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3a0b6f8b-f7e9-4924-97b4-f2a86a4249a1 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Flow 'volume_create_manager' (654ad9b7-3666-4ff6-9394-6d48fdcaf1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3a0b6f8b-f7e9-4924-97b4-f2a86a4249a1 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dae7c06-29f8-4dda-aa90-b5ff26e69f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:50 devstack sudo[91972]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3a0b6f8b-f7e9-4924-97b4-f2a86a4249a1 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dae7c06-29f8-4dda-aa90-b5ff26e69f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1554126579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe49dc4a-f05a-46ea-8cdf-277eb79c094f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f2aa563dc3748f39a665a296ede003b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:50Z,use_quota=True,user_id='8091c8456908436496de23c84eada06e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3a0b6f8b-f7e9-4924-97b4-f2a86a4249a1 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75dbbafc-075d-4425-8263-eece5e620dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3a0b6f8b-f7e9-4924-97b4-f2a86a4249a1 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75dbbafc-075d-4425-8263-eece5e620dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3a0b6f8b-f7e9-4924-97b4-f2a86a4249a1 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fc0aba2-eea4-4bcb-846d-60f7caa4bf1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3a0b6f8b-f7e9-4924-97b4-f2a86a4249a1 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fc0aba2-eea4-4bcb-846d-60f7caa4bf1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe49dc4a-f05a-46ea-8cdf-277eb79c094f', 'volume_name': 'volume-fe49dc4a-f05a-46ea-8cdf-277eb79c094f', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3a0b6f8b-f7e9-4924-97b4-f2a86a4249a1 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (333c77f6-be5f-4033-b10f-24d09c0d71ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3a0b6f8b-f7e9-4924-97b4-f2a86a4249a1 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (333c77f6-be5f-4033-b10f-24d09c0d71ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3a0b6f8b-f7e9-4924-97b4-f2a86a4249a1 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee2e5a58-f7b8-448e-a72d-65db1a509575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:50 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-3a0b6f8b-f7e9-4924-97b4-f2a86a4249a1 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Volume fe49dc4a-f05a-46ea-8cdf-277eb79c094f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe49dc4a-f05a-46ea-8cdf-277eb79c094f', 'volume_size': 1}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3a0b6f8b-f7e9-4924-97b4-f2a86a4249a1 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3026e411-61c9-4101-998e-9c51aee7d151 tempest-VolumeDependencyTests-581964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e0a6fda7-1a49-497b-b913-d3e61e68d96e" returned: 0 in 0.555s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-3026e411-61c9-4101-998e-9c51aee7d151 tempest-VolumeDependencyTests-581964465 None] Lock "cinder-quobyte-e0a6fda7-1a49-497b-b913-d3e61e68d96e" released by "delete_volume" :: held 1.141s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-3026e411-61c9-4101-998e-9c51aee7d151 tempest-VolumeDependencyTests-581964465 None] Created reservations ['3b5eccf2-1c5e-4205-9eb5-ead7305d761e', '37bc7cf3-430e-45bc-8c58-f8d24c356294', '67e68d56-cbac-46ca-addc-997cadeb92da', '6c532b67-1387-421e-a9c3-f4cb67191c16'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3026e411-61c9-4101-998e-9c51aee7d151 tempest-VolumeDependencyTests-581964465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3026e411-61c9-4101-998e-9c51aee7d151 tempest-VolumeDependencyTests-581964465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-3026e411-61c9-4101-998e-9c51aee7d151 tempest-VolumeDependencyTests-581964465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-3026e411-61c9-4101-998e-9c51aee7d151 tempest-VolumeDependencyTests-581964465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3026e411-61c9-4101-998e-9c51aee7d151 tempest-VolumeDependencyTests-581964465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3026e411-61c9-4101-998e-9c51aee7d151 tempest-VolumeDependencyTests-581964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:50 devstack sudo[91978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:50:50 devstack sudo[91978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ec7bf5a-8b54-44a2-9f6c-c9a64dbe7e56 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3ec7bf5a-8b54-44a2-9f6c-c9a64dbe7e56 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Flow 'volume_create_manager' (262eea5f-8897-4b8e-8069-31577ed0eddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3ec7bf5a-8b54-44a2-9f6c-c9a64dbe7e56 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d698d69-8e5f-4207-a4b0-3bf13f9cfdbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3ec7bf5a-8b54-44a2-9f6c-c9a64dbe7e56 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d698d69-8e5f-4207-a4b0-3bf13f9cfdbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-841005612',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e92b3def-3424-458b-9869-af92a14456c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f2aa563dc3748f39a665a296ede003b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:50Z,use_quota=True,user_id='8091c8456908436496de23c84eada06e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3ec7bf5a-8b54-44a2-9f6c-c9a64dbe7e56 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dd41297-9e47-40c3-b649-f23dc858d378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3ec7bf5a-8b54-44a2-9f6c-c9a64dbe7e56 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dd41297-9e47-40c3-b649-f23dc858d378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3ec7bf5a-8b54-44a2-9f6c-c9a64dbe7e56 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e6fda1d-c5df-4a11-a207-9800a3f48c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3ec7bf5a-8b54-44a2-9f6c-c9a64dbe7e56 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e6fda1d-c5df-4a11-a207-9800a3f48c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e92b3def-3424-458b-9869-af92a14456c1', 'volume_name': 'volume-e92b3def-3424-458b-9869-af92a14456c1', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3ec7bf5a-8b54-44a2-9f6c-c9a64dbe7e56 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc8e0bc2-a35f-45ae-b337-c617b0a882c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3ec7bf5a-8b54-44a2-9f6c-c9a64dbe7e56 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc8e0bc2-a35f-45ae-b337-c617b0a882c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3ec7bf5a-8b54-44a2-9f6c-c9a64dbe7e56 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (849d7e88-bbe2-471e-9e84-f078a80bbf92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:50 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-3ec7bf5a-8b54-44a2-9f6c-c9a64dbe7e56 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Volume e92b3def-3424-458b-9869-af92a14456c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e92b3def-3424-458b-9869-af92a14456c1', 'volume_size': 1}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3ec7bf5a-8b54-44a2-9f6c-c9a64dbe7e56 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:50 devstack sudo[91975]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aab1fb2-1f5e-49ee-a9de-5688c8307297 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9aab1fb2-1f5e-49ee-a9de-5688c8307297 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Flow 'volume_create_manager' (58c14050-4274-4c48-9ef8-4be876723dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9aab1fb2-1f5e-49ee-a9de-5688c8307297 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bff3dd0a-dc91-4c46-a03e-a61f654ac3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9aab1fb2-1f5e-49ee-a9de-5688c8307297 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bff3dd0a-dc91-4c46-a03e-a61f654ac3f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-9067648',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7741c11-7d5d-4f13-bfc1-ab526258a9ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f2aa563dc3748f39a665a296ede003b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:50Z,use_quota=True,user_id='8091c8456908436496de23c84eada06e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9aab1fb2-1f5e-49ee-a9de-5688c8307297 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61ce9404-0089-4b49-b72f-20282da49d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9aab1fb2-1f5e-49ee-a9de-5688c8307297 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61ce9404-0089-4b49-b72f-20282da49d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9aab1fb2-1f5e-49ee-a9de-5688c8307297 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cef59840-add9-46da-a3f5-2b04eb5c7266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9aab1fb2-1f5e-49ee-a9de-5688c8307297 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cef59840-add9-46da-a3f5-2b04eb5c7266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7741c11-7d5d-4f13-bfc1-ab526258a9ed', 'volume_name': 'volume-c7741c11-7d5d-4f13-bfc1-ab526258a9ed', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9aab1fb2-1f5e-49ee-a9de-5688c8307297 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4c01d05-7ce1-44c6-b7b8-18ee802f4587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9aab1fb2-1f5e-49ee-a9de-5688c8307297 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4c01d05-7ce1-44c6-b7b8-18ee802f4587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9aab1fb2-1f5e-49ee-a9de-5688c8307297 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beb9cdbf-4ec2-452c-9543-2472521a93d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:50 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-9aab1fb2-1f5e-49ee-a9de-5688c8307297 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Volume c7741c11-7d5d-4f13-bfc1-ab526258a9ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7741c11-7d5d-4f13-bfc1-ab526258a9ed', 'volume_size': 1}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-9aab1fb2-1f5e-49ee-a9de-5688c8307297 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ba7197ec-df05-407f-878b-a930c3d85867 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-df04dcbb-0e9c-4c55-ae52-2fcc74b7bace 1073741824" returned: 0 in 0.624s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ba7197ec-df05-407f-878b-a930c3d85867 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-df04dcbb-0e9c-4c55-ae52-2fcc74b7bace {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:50 devstack sudo[91983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-df04dcbb-0e9c-4c55-ae52-2fcc74b7bace
Feb 28 04:50:50 devstack sudo[91983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd95d473-bd1f-4114-a654-e2ce2d7386df tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-bd95d473-bd1f-4114-a654-e2ce2d7386df tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Flow 'volume_create_manager' (c6fcde86-adf4-4f8b-a989-c16856fae4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-bd95d473-bd1f-4114-a654-e2ce2d7386df tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e015333e-ee0c-4e68-844e-1418fac66f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-bd95d473-bd1f-4114-a654-e2ce2d7386df tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e015333e-ee0c-4e68-844e-1418fac66f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-641316273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d7ae313-772d-46d1-910d-380646fa2181,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f2aa563dc3748f39a665a296ede003b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:51Z,use_quota=True,user_id='8091c8456908436496de23c84eada06e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-bd95d473-bd1f-4114-a654-e2ce2d7386df tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (601ecc3e-88c8-47f8-aa21-0a28dc8f21bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-bd95d473-bd1f-4114-a654-e2ce2d7386df tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (601ecc3e-88c8-47f8-aa21-0a28dc8f21bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-bd95d473-bd1f-4114-a654-e2ce2d7386df tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31c92522-f151-401f-b7fe-5ce3c2cf3215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-bd95d473-bd1f-4114-a654-e2ce2d7386df tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31c92522-f151-401f-b7fe-5ce3c2cf3215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d7ae313-772d-46d1-910d-380646fa2181', 'volume_name': 'volume-3d7ae313-772d-46d1-910d-380646fa2181', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-bd95d473-bd1f-4114-a654-e2ce2d7386df tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dced08b-c2db-4f23-aa15-ac22d27b8641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-bd95d473-bd1f-4114-a654-e2ce2d7386df tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dced08b-c2db-4f23-aa15-ac22d27b8641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-bd95d473-bd1f-4114-a654-e2ce2d7386df tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e6cfaa2-3920-4e46-a4ae-0c68bfe01ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:50 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-bd95d473-bd1f-4114-a654-e2ce2d7386df tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Volume 3d7ae313-772d-46d1-910d-380646fa2181: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d7ae313-772d-46d1-910d-380646fa2181', 'volume_size': 1}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-bd95d473-bd1f-4114-a654-e2ce2d7386df tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:50 devstack sudo[91978]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3026e411-61c9-4101-998e-9c51aee7d151 tempest-VolumeDependencyTests-581964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.515s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-3026e411-61c9-4101-998e-9c51aee7d151 tempest-VolumeDependencyTests-581964465 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:50:50 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-3026e411-61c9-4101-998e-9c51aee7d151 tempest-VolumeDependencyTests-581964465 None] Deleted volume successfully.
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-3026e411-61c9-4101-998e-9c51aee7d151 tempest-VolumeDependencyTests-581964465 None] Lock "cinder-e0a6fda7-1a49-497b-b913-d3e61e68d96e-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:50 devstack sudo[91983]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-ba7197ec-df05-407f-878b-a930c3d85867 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-df04dcbb-0e9c-4c55-ae52-2fcc74b7bace" returned: 0 in 0.441s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-ba7197ec-df05-407f-878b-a930c3d85867 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-ba7197ec-df05-407f-878b-a930c3d85867 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3a0b6f8b-f7e9-4924-97b4-f2a86a4249a1 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.879s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-3a0b6f8b-f7e9-4924-97b4-f2a86a4249a1 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1554126579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe49dc4a-f05a-46ea-8cdf-277eb79c094f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f2aa563dc3748f39a665a296ede003b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:50Z,use_quota=True,user_id='8091c8456908436496de23c84eada06e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-3a0b6f8b-f7e9-4924-97b4-f2a86a4249a1 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Creating volume fe49dc4a-f05a-46ea-8cdf-277eb79c094f {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3a0b6f8b-f7e9-4924-97b4-f2a86a4249a1 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3a0b6f8b-f7e9-4924-97b4-f2a86a4249a1 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-3a0b6f8b-f7e9-4924-97b4-f2a86a4249a1 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-3a0b6f8b-f7e9-4924-97b4-f2a86a4249a1 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3a0b6f8b-f7e9-4924-97b4-f2a86a4249a1 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-3a0b6f8b-f7e9-4924-97b4-f2a86a4249a1 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:50:50 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-3a0b6f8b-f7e9-4924-97b4-f2a86a4249a1 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:50:50 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3a0b6f8b-f7e9-4924-97b4-f2a86a4249a1 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-fe49dc4a-f05a-46ea-8cdf-277eb79c094f 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ba7197ec-df05-407f-878b-a930c3d85867 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11b30e49-8e82-4b66-88e1-4f27a1e2fa25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df04dcbb-0e9c-4c55-ae52-2fcc74b7bace', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:51 devstack sudo[91987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-fe49dc4a-f05a-46ea-8cdf-277eb79c094f 1073741824
Feb 28 04:50:51 devstack sudo[91987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ba7197ec-df05-407f-878b-a930c3d85867 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b38f42fc-d202-428e-b40b-1f6bf4cff0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:51 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-ba7197ec-df05-407f-878b-a930c3d85867 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Volume volume-df04dcbb-0e9c-4c55-ae52-2fcc74b7bace (df04dcbb-0e9c-4c55-ae52-2fcc74b7bace): created successfully
Feb 28 04:50:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ba7197ec-df05-407f-878b-a930c3d85867 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b38f42fc-d202-428e-b40b-1f6bf4cff0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-ba7197ec-df05-407f-878b-a930c3d85867 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Flow 'volume_create_manager' (8c7c0c70-d78c-4915-9aa1-afeefe66f0a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:51 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-ba7197ec-df05-407f-878b-a930c3d85867 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Created volume successfully.
Feb 28 04:50:51 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-aaa9dc52-a266-4574-93a7-42a4d0667dd2 tempest-VolumeDependencyTests-581964465 None] Acquiring lock "cinder-77a601ea-3219-440c-bf88-7c98ae15d303-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:51 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-aaa9dc52-a266-4574-93a7-42a4d0667dd2 tempest-VolumeDependencyTests-581964465 None] Lock "cinder-77a601ea-3219-440c-bf88-7c98ae15d303-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:51 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-aaa9dc52-a266-4574-93a7-42a4d0667dd2 tempest-VolumeDependencyTests-581964465 None] Acquiring lock "cinder-quobyte-77a601ea-3219-440c-bf88-7c98ae15d303" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:51 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-aaa9dc52-a266-4574-93a7-42a4d0667dd2 tempest-VolumeDependencyTests-581964465 None] Lock "cinder-quobyte-77a601ea-3219-440c-bf88-7c98ae15d303" acquired by "delete_volume" :: waited 0.011s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:51 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a97221-cd5b-4eca-a4a0-fb309dfc82e2]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-aaa9dc52-a266-4574-93a7-42a4d0667dd2 tempest-VolumeDependencyTests-581964465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-77a601ea-3219-440c-bf88-7c98ae15d303 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:51 devstack sudo[91989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-77a601ea-3219-440c-bf88-7c98ae15d303
Feb 28 04:50:51 devstack sudo[91989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:51 devstack sudo[91987]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3a0b6f8b-f7e9-4924-97b4-f2a86a4249a1 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-fe49dc4a-f05a-46ea-8cdf-277eb79c094f 1073741824" returned: 0 in 0.476s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3a0b6f8b-f7e9-4924-97b4-f2a86a4249a1 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-fe49dc4a-f05a-46ea-8cdf-277eb79c094f {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:51 devstack sudo[91994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-fe49dc4a-f05a-46ea-8cdf-277eb79c094f
Feb 28 04:50:51 devstack sudo[91994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:51 devstack sudo[91989]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-aaa9dc52-a266-4574-93a7-42a4d0667dd2 tempest-VolumeDependencyTests-581964465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-77a601ea-3219-440c-bf88-7c98ae15d303" returned: 0 in 0.500s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-aaa9dc52-a266-4574-93a7-42a4d0667dd2 tempest-VolumeDependencyTests-581964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-77a601ea-3219-440c-bf88-7c98ae15d303 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:51 devstack sudo[92001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-77a601ea-3219-440c-bf88-7c98ae15d303
Feb 28 04:50:51 devstack sudo[92001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:51 devstack sudo[91994]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3a0b6f8b-f7e9-4924-97b4-f2a86a4249a1 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-fe49dc4a-f05a-46ea-8cdf-277eb79c094f" returned: 0 in 0.423s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:51 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-3a0b6f8b-f7e9-4924-97b4-f2a86a4249a1 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:50:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3a0b6f8b-f7e9-4924-97b4-f2a86a4249a1 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3ec7bf5a-8b54-44a2-9f6c-c9a64dbe7e56 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.599s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:51 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-3ec7bf5a-8b54-44a2-9f6c-c9a64dbe7e56 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-841005612',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e92b3def-3424-458b-9869-af92a14456c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f2aa563dc3748f39a665a296ede003b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:50Z,use_quota=True,user_id='8091c8456908436496de23c84eada06e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:50:51 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-3ec7bf5a-8b54-44a2-9f6c-c9a64dbe7e56 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Creating volume e92b3def-3424-458b-9869-af92a14456c1 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:50:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3ec7bf5a-8b54-44a2-9f6c-c9a64dbe7e56 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3ec7bf5a-8b54-44a2-9f6c-c9a64dbe7e56 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:51 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-3ec7bf5a-8b54-44a2-9f6c-c9a64dbe7e56 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:51 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-3ec7bf5a-8b54-44a2-9f6c-c9a64dbe7e56 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3ec7bf5a-8b54-44a2-9f6c-c9a64dbe7e56 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:51 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-3ec7bf5a-8b54-44a2-9f6c-c9a64dbe7e56 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:50:51 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-3ec7bf5a-8b54-44a2-9f6c-c9a64dbe7e56 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:50:51 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3ec7bf5a-8b54-44a2-9f6c-c9a64dbe7e56 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e92b3def-3424-458b-9869-af92a14456c1 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3a0b6f8b-f7e9-4924-97b4-f2a86a4249a1 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee2e5a58-f7b8-448e-a72d-65db1a509575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe49dc4a-f05a-46ea-8cdf-277eb79c094f', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:51 devstack sudo[92004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e92b3def-3424-458b-9869-af92a14456c1 1073741824
Feb 28 04:50:51 devstack sudo[92004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3a0b6f8b-f7e9-4924-97b4-f2a86a4249a1 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75b077af-2033-455b-a461-86ada346c07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:51 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-3a0b6f8b-f7e9-4924-97b4-f2a86a4249a1 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Volume volume-fe49dc4a-f05a-46ea-8cdf-277eb79c094f (fe49dc4a-f05a-46ea-8cdf-277eb79c094f): created successfully
Feb 28 04:50:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3a0b6f8b-f7e9-4924-97b4-f2a86a4249a1 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75b077af-2033-455b-a461-86ada346c07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:51 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3a0b6f8b-f7e9-4924-97b4-f2a86a4249a1 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Flow 'volume_create_manager' (654ad9b7-3666-4ff6-9394-6d48fdcaf1c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:51 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-3a0b6f8b-f7e9-4924-97b4-f2a86a4249a1 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Created volume successfully.
Feb 28 04:50:52 devstack sudo[92001]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-aaa9dc52-a266-4574-93a7-42a4d0667dd2 tempest-VolumeDependencyTests-581964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-77a601ea-3219-440c-bf88-7c98ae15d303" returned: 0 in 0.406s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:52 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-aaa9dc52-a266-4574-93a7-42a4d0667dd2 tempest-VolumeDependencyTests-581964465 None] Lock "cinder-quobyte-77a601ea-3219-440c-bf88-7c98ae15d303" released by "delete_volume" :: held 0.938s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:52 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-aaa9dc52-a266-4574-93a7-42a4d0667dd2 tempest-VolumeDependencyTests-581964465 None] Created reservations ['1ddd4a53-c130-4319-a3b5-43e9c1fa2dae', 'afa7fc1b-82fd-4b8b-a6ef-3290600dbce3', '9d535757-2b44-4591-bd59-becad87e8e19', '6dcf4311-bc7b-44c4-af12-a21a5b225bbb'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:50:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-aaa9dc52-a266-4574-93a7-42a4d0667dd2 tempest-VolumeDependencyTests-581964465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-aaa9dc52-a266-4574-93a7-42a4d0667dd2 tempest-VolumeDependencyTests-581964465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:52 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-aaa9dc52-a266-4574-93a7-42a4d0667dd2 tempest-VolumeDependencyTests-581964465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:52 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-aaa9dc52-a266-4574-93a7-42a4d0667dd2 tempest-VolumeDependencyTests-581964465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-aaa9dc52-a266-4574-93a7-42a4d0667dd2 tempest-VolumeDependencyTests-581964465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-aaa9dc52-a266-4574-93a7-42a4d0667dd2 tempest-VolumeDependencyTests-581964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:52 devstack sudo[92007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:50:52 devstack sudo[92007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:52 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-2cc4646e-c959-4c70-ae4c-0897e09e8679 tempest-VolumeDependencyTests-581964465 None] Acquiring lock "cinder-f990e796-0484-4b6e-a2d3-f95b6181eb43-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:52 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-2cc4646e-c959-4c70-ae4c-0897e09e8679 tempest-VolumeDependencyTests-581964465 None] Lock "cinder-f990e796-0484-4b6e-a2d3-f95b6181eb43-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:52 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-2cc4646e-c959-4c70-ae4c-0897e09e8679 tempest-VolumeDependencyTests-581964465 None] Acquiring lock "cinder-quobyte-f990e796-0484-4b6e-a2d3-f95b6181eb43" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:52 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-2cc4646e-c959-4c70-ae4c-0897e09e8679 tempest-VolumeDependencyTests-581964465 None] Lock "cinder-quobyte-f990e796-0484-4b6e-a2d3-f95b6181eb43" acquired by "delete_volume" :: waited 0.007s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:52 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[039b8088-dbdb-4b15-ac5e-e4e518fb9d4a]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-2cc4646e-c959-4c70-ae4c-0897e09e8679 tempest-VolumeDependencyTests-581964465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f990e796-0484-4b6e-a2d3-f95b6181eb43 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:52 devstack sudo[92004]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3ec7bf5a-8b54-44a2-9f6c-c9a64dbe7e56 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e92b3def-3424-458b-9869-af92a14456c1 1073741824" returned: 0 in 0.495s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3ec7bf5a-8b54-44a2-9f6c-c9a64dbe7e56 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e92b3def-3424-458b-9869-af92a14456c1 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:52 devstack sudo[92012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f990e796-0484-4b6e-a2d3-f95b6181eb43
Feb 28 04:50:52 devstack sudo[92012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:52 devstack sudo[92014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e92b3def-3424-458b-9869-af92a14456c1
Feb 28 04:50:52 devstack sudo[92014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:52 devstack sudo[92007]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-aaa9dc52-a266-4574-93a7-42a4d0667dd2 tempest-VolumeDependencyTests-581964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.479s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:52 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-aaa9dc52-a266-4574-93a7-42a4d0667dd2 tempest-VolumeDependencyTests-581964465 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:50:52 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-aaa9dc52-a266-4574-93a7-42a4d0667dd2 tempest-VolumeDependencyTests-581964465 None] Deleted volume successfully.
Feb 28 04:50:52 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-aaa9dc52-a266-4574-93a7-42a4d0667dd2 tempest-VolumeDependencyTests-581964465 None] Lock "cinder-77a601ea-3219-440c-bf88-7c98ae15d303-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:52 devstack sudo[92012]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-2cc4646e-c959-4c70-ae4c-0897e09e8679 tempest-VolumeDependencyTests-581964465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f990e796-0484-4b6e-a2d3-f95b6181eb43" returned: 0 in 0.482s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-2cc4646e-c959-4c70-ae4c-0897e09e8679 tempest-VolumeDependencyTests-581964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f990e796-0484-4b6e-a2d3-f95b6181eb43 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:52 devstack sudo[92014]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:52 devstack sudo[92021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f990e796-0484-4b6e-a2d3-f95b6181eb43
Feb 28 04:50:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-3ec7bf5a-8b54-44a2-9f6c-c9a64dbe7e56 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e92b3def-3424-458b-9869-af92a14456c1" returned: 0 in 0.432s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:52 devstack sudo[92021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:52 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-3ec7bf5a-8b54-44a2-9f6c-c9a64dbe7e56 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:50:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-3ec7bf5a-8b54-44a2-9f6c-c9a64dbe7e56 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-9aab1fb2-1f5e-49ee-a9de-5688c8307297 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.368s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:52 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-9aab1fb2-1f5e-49ee-a9de-5688c8307297 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-9067648',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7741c11-7d5d-4f13-bfc1-ab526258a9ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f2aa563dc3748f39a665a296ede003b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:50Z,use_quota=True,user_id='8091c8456908436496de23c84eada06e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:50:52 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-9aab1fb2-1f5e-49ee-a9de-5688c8307297 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Creating volume c7741c11-7d5d-4f13-bfc1-ab526258a9ed {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:50:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-9aab1fb2-1f5e-49ee-a9de-5688c8307297 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-9aab1fb2-1f5e-49ee-a9de-5688c8307297 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:52 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-9aab1fb2-1f5e-49ee-a9de-5688c8307297 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:52 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-9aab1fb2-1f5e-49ee-a9de-5688c8307297 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-9aab1fb2-1f5e-49ee-a9de-5688c8307297 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:52 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-9aab1fb2-1f5e-49ee-a9de-5688c8307297 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:50:52 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-9aab1fb2-1f5e-49ee-a9de-5688c8307297 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:50:52 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9aab1fb2-1f5e-49ee-a9de-5688c8307297 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c7741c11-7d5d-4f13-bfc1-ab526258a9ed 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:52 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3ec7bf5a-8b54-44a2-9f6c-c9a64dbe7e56 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (849d7e88-bbe2-471e-9e84-f078a80bbf92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e92b3def-3424-458b-9869-af92a14456c1', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:52 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3ec7bf5a-8b54-44a2-9f6c-c9a64dbe7e56 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b332e67b-f86f-4b36-98f7-dadd1cd8aae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:52 devstack sudo[92023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c7741c11-7d5d-4f13-bfc1-ab526258a9ed 1073741824
Feb 28 04:50:52 devstack sudo[92023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:52 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-3ec7bf5a-8b54-44a2-9f6c-c9a64dbe7e56 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Volume volume-e92b3def-3424-458b-9869-af92a14456c1 (e92b3def-3424-458b-9869-af92a14456c1): created successfully
Feb 28 04:50:52 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3ec7bf5a-8b54-44a2-9f6c-c9a64dbe7e56 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b332e67b-f86f-4b36-98f7-dadd1cd8aae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:52 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-3ec7bf5a-8b54-44a2-9f6c-c9a64dbe7e56 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Flow 'volume_create_manager' (262eea5f-8897-4b8e-8069-31577ed0eddf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:52 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-3ec7bf5a-8b54-44a2-9f6c-c9a64dbe7e56 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Created volume successfully.
Feb 28 04:50:53 devstack sudo[92021]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-2cc4646e-c959-4c70-ae4c-0897e09e8679 tempest-VolumeDependencyTests-581964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-f990e796-0484-4b6e-a2d3-f95b6181eb43" returned: 0 in 0.423s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:53 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-2cc4646e-c959-4c70-ae4c-0897e09e8679 tempest-VolumeDependencyTests-581964465 None] Lock "cinder-quobyte-f990e796-0484-4b6e-a2d3-f95b6181eb43" released by "delete_volume" :: held 0.925s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:53 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-2cc4646e-c959-4c70-ae4c-0897e09e8679 tempest-VolumeDependencyTests-581964465 None] Created reservations ['8339b407-e052-4247-9352-0af35beb401b', 'c4c39a91-0235-47d8-b67e-0adf5c20e416', '6c0984e3-2aa1-4adb-aa47-c0ed20968819', 'f0ab18e7-09e1-42ea-b575-7e158efa1a30'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:50:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-2cc4646e-c959-4c70-ae4c-0897e09e8679 tempest-VolumeDependencyTests-581964465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-2cc4646e-c959-4c70-ae4c-0897e09e8679 tempest-VolumeDependencyTests-581964465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:53 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-2cc4646e-c959-4c70-ae4c-0897e09e8679 tempest-VolumeDependencyTests-581964465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:53 devstack sudo[92023]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:53 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-2cc4646e-c959-4c70-ae4c-0897e09e8679 tempest-VolumeDependencyTests-581964465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-2cc4646e-c959-4c70-ae4c-0897e09e8679 tempest-VolumeDependencyTests-581964465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-2cc4646e-c959-4c70-ae4c-0897e09e8679 tempest-VolumeDependencyTests-581964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9aab1fb2-1f5e-49ee-a9de-5688c8307297 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c7741c11-7d5d-4f13-bfc1-ab526258a9ed 1073741824" returned: 0 in 0.485s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:53 devstack sudo[92029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:50:53 devstack sudo[92029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9aab1fb2-1f5e-49ee-a9de-5688c8307297 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c7741c11-7d5d-4f13-bfc1-ab526258a9ed {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:53 devstack sudo[92031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c7741c11-7d5d-4f13-bfc1-ab526258a9ed
Feb 28 04:50:53 devstack sudo[92031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:53 devstack sudo[92029]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-2cc4646e-c959-4c70-ae4c-0897e09e8679 tempest-VolumeDependencyTests-581964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.410s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:53 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-2cc4646e-c959-4c70-ae4c-0897e09e8679 tempest-VolumeDependencyTests-581964465 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:50:53 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-2cc4646e-c959-4c70-ae4c-0897e09e8679 tempest-VolumeDependencyTests-581964465 None] Deleted volume successfully.
Feb 28 04:50:53 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-2cc4646e-c959-4c70-ae4c-0897e09e8679 tempest-VolumeDependencyTests-581964465 None] Lock "cinder-f990e796-0484-4b6e-a2d3-f95b6181eb43-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:53 devstack sudo[92031]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-9aab1fb2-1f5e-49ee-a9de-5688c8307297 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c7741c11-7d5d-4f13-bfc1-ab526258a9ed" returned: 0 in 0.463s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:53 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-9aab1fb2-1f5e-49ee-a9de-5688c8307297 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:50:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-9aab1fb2-1f5e-49ee-a9de-5688c8307297 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-bd95d473-bd1f-4114-a654-e2ce2d7386df tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.174s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:53 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-bd95d473-bd1f-4114-a654-e2ce2d7386df tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5e40e7afe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T03:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-641316273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d7ae313-772d-46d1-910d-380646fa2181,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f2aa563dc3748f39a665a296ede003b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T03:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T03:50:51Z,use_quota=True,user_id='8091c8456908436496de23c84eada06e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac00da32-832f-4dd1-b9db-e4073e8edb0f),volume_type_id=ac00da32-832f-4dd1-b9db-e4073e8edb0f)}" {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 04:50:53 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.remotefs [None req-bd95d473-bd1f-4114-a654-e2ce2d7386df tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Creating volume 3d7ae313-772d-46d1-910d-380646fa2181 {{(pid=84248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 04:50:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-bd95d473-bd1f-4114-a654-e2ce2d7386df tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-bd95d473-bd1f-4114-a654-e2ce2d7386df tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:53 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-bd95d473-bd1f-4114-a654-e2ce2d7386df tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:53 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-bd95d473-bd1f-4114-a654-e2ce2d7386df tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-bd95d473-bd1f-4114-a654-e2ce2d7386df tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:53 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-bd95d473-bd1f-4114-a654-e2ce2d7386df tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Selected osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035 as target Quobyte volume. {{(pid=84248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 04:50:53 devstack cinder-volume[84248]: INFO cinder.volume.drivers.remotefs [None req-bd95d473-bd1f-4114-a654-e2ce2d7386df tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] casted to osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035
Feb 28 04:50:53 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-bd95d473-bd1f-4114-a654-e2ce2d7386df tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3d7ae313-772d-46d1-910d-380646fa2181 1073741824 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:53 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9aab1fb2-1f5e-49ee-a9de-5688c8307297 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beb9cdbf-4ec2-452c-9543-2472521a93d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7741c11-7d5d-4f13-bfc1-ab526258a9ed', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:53 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9aab1fb2-1f5e-49ee-a9de-5688c8307297 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7067d2f0-edb3-430e-8bfc-bd8bba127dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:53 devstack sudo[92035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3d7ae313-772d-46d1-910d-380646fa2181 1073741824
Feb 28 04:50:53 devstack sudo[92035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:53 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-9aab1fb2-1f5e-49ee-a9de-5688c8307297 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Volume volume-c7741c11-7d5d-4f13-bfc1-ab526258a9ed (c7741c11-7d5d-4f13-bfc1-ab526258a9ed): created successfully
Feb 28 04:50:53 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9aab1fb2-1f5e-49ee-a9de-5688c8307297 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7067d2f0-edb3-430e-8bfc-bd8bba127dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:53 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-9aab1fb2-1f5e-49ee-a9de-5688c8307297 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Flow 'volume_create_manager' (58c14050-4274-4c48-9ef8-4be876723dfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:53 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-9aab1fb2-1f5e-49ee-a9de-5688c8307297 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Created volume successfully.
Feb 28 04:50:54 devstack sudo[92035]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-bd95d473-bd1f-4114-a654-e2ce2d7386df tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3d7ae313-772d-46d1-910d-380646fa2181 1073741824" returned: 0 in 0.519s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-bd95d473-bd1f-4114-a654-e2ce2d7386df tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3d7ae313-772d-46d1-910d-380646fa2181 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:54 devstack sudo[92040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3d7ae313-772d-46d1-910d-380646fa2181
Feb 28 04:50:54 devstack sudo[92040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:54 devstack sudo[92040]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-bd95d473-bd1f-4114-a654-e2ce2d7386df tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3d7ae313-772d-46d1-910d-380646fa2181" returned: 0 in 0.422s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:54 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-bd95d473-bd1f-4114-a654-e2ce2d7386df tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'} {{(pid=84248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 04:50:54 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-bd95d473-bd1f-4114-a654-e2ce2d7386df tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:54 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-bd95d473-bd1f-4114-a654-e2ce2d7386df tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e6cfaa2-3920-4e46-a4ae-0c68bfe01ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d7ae313-772d-46d1-910d-380646fa2181', 'volume_size': 1}' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:54 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-bd95d473-bd1f-4114-a654-e2ce2d7386df tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d977d6dc-6f5b-4df0-bc0b-72d8c9423db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 04:50:54 devstack cinder-volume[84248]: INFO cinder.volume.flows.manager.create_volume [None req-bd95d473-bd1f-4114-a654-e2ce2d7386df tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Volume volume-3d7ae313-772d-46d1-910d-380646fa2181 (3d7ae313-772d-46d1-910d-380646fa2181): created successfully
Feb 28 04:50:54 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-bd95d473-bd1f-4114-a654-e2ce2d7386df tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d977d6dc-6f5b-4df0-bc0b-72d8c9423db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84248) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 04:50:54 devstack cinder-volume[84248]: DEBUG cinder.volume.manager [None req-bd95d473-bd1f-4114-a654-e2ce2d7386df tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Flow 'volume_create_manager' (c6fcde86-adf4-4f8b-a989-c16856fae4d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84248) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 04:50:54 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-bd95d473-bd1f-4114-a654-e2ce2d7386df tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Created volume successfully.
Feb 28 04:50:55 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-4d0ce814-693d-408e-975e-0d3ba4f205b5 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Acquiring lock "cinder-3d7ae313-772d-46d1-910d-380646fa2181-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:55 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-4d0ce814-693d-408e-975e-0d3ba4f205b5 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "cinder-3d7ae313-772d-46d1-910d-380646fa2181-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:55 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-4d0ce814-693d-408e-975e-0d3ba4f205b5 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Acquiring lock "cinder-quobyte-3d7ae313-772d-46d1-910d-380646fa2181" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:55 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-4d0ce814-693d-408e-975e-0d3ba4f205b5 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "cinder-quobyte-3d7ae313-772d-46d1-910d-380646fa2181" acquired by "delete_volume" :: waited 0.008s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:55 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1aa4e3-9214-42af-8d05-41718b7abf76]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4d0ce814-693d-408e-975e-0d3ba4f205b5 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3d7ae313-772d-46d1-910d-380646fa2181 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:55 devstack sudo[92043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3d7ae313-772d-46d1-910d-380646fa2181
Feb 28 04:50:55 devstack sudo[92043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:55 devstack sudo[92043]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4d0ce814-693d-408e-975e-0d3ba4f205b5 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3d7ae313-772d-46d1-910d-380646fa2181" returned: 0 in 0.465s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4d0ce814-693d-408e-975e-0d3ba4f205b5 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3d7ae313-772d-46d1-910d-380646fa2181 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:55 devstack sudo[92048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3d7ae313-772d-46d1-910d-380646fa2181
Feb 28 04:50:55 devstack sudo[92048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:55 devstack sudo[92048]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:55 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4d0ce814-693d-408e-975e-0d3ba4f205b5 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-3d7ae313-772d-46d1-910d-380646fa2181" returned: 0 in 0.398s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:55 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-4d0ce814-693d-408e-975e-0d3ba4f205b5 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "cinder-quobyte-3d7ae313-772d-46d1-910d-380646fa2181" released by "delete_volume" :: held 0.886s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:55 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-4d0ce814-693d-408e-975e-0d3ba4f205b5 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Created reservations ['8904f279-50d9-49be-b6d2-4f0a85de1168', 'b3ec4934-fbba-46db-b666-b7e95d9b4823', '4fac0a19-523b-49ff-a964-6bd9d125b0e8', 'c020a47c-6f8e-4b6c-927b-cd9902047b64'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:50:56 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-4d0ce814-693d-408e-975e-0d3ba4f205b5 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:56 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-4d0ce814-693d-408e-975e-0d3ba4f205b5 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:56 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-4d0ce814-693d-408e-975e-0d3ba4f205b5 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:56 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-4d0ce814-693d-408e-975e-0d3ba4f205b5 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:56 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-4d0ce814-693d-408e-975e-0d3ba4f205b5 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:56 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4d0ce814-693d-408e-975e-0d3ba4f205b5 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:56 devstack sudo[92051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:50:56 devstack sudo[92051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:56 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8159a940-de22-4cc3-b309-6e46843ffeeb tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Acquiring lock "cinder-c7741c11-7d5d-4f13-bfc1-ab526258a9ed-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:56 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8159a940-de22-4cc3-b309-6e46843ffeeb tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "cinder-c7741c11-7d5d-4f13-bfc1-ab526258a9ed-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:56 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8159a940-de22-4cc3-b309-6e46843ffeeb tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Acquiring lock "cinder-quobyte-c7741c11-7d5d-4f13-bfc1-ab526258a9ed" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:56 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8159a940-de22-4cc3-b309-6e46843ffeeb tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "cinder-quobyte-c7741c11-7d5d-4f13-bfc1-ab526258a9ed" acquired by "delete_volume" :: waited 0.007s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:56 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68241bf-0f47-414e-b399-c694bec3c055]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:56 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8159a940-de22-4cc3-b309-6e46843ffeeb tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c7741c11-7d5d-4f13-bfc1-ab526258a9ed {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:56 devstack sudo[92053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c7741c11-7d5d-4f13-bfc1-ab526258a9ed
Feb 28 04:50:56 devstack sudo[92053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:56 devstack sudo[92051]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:56 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-4d0ce814-693d-408e-975e-0d3ba4f205b5 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.434s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:56 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-4d0ce814-693d-408e-975e-0d3ba4f205b5 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:50:56 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-4d0ce814-693d-408e-975e-0d3ba4f205b5 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Deleted volume successfully.
Feb 28 04:50:56 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-4d0ce814-693d-408e-975e-0d3ba4f205b5 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "cinder-3d7ae313-772d-46d1-910d-380646fa2181-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:56 devstack sudo[92053]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:56 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8159a940-de22-4cc3-b309-6e46843ffeeb tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c7741c11-7d5d-4f13-bfc1-ab526258a9ed" returned: 0 in 0.467s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:56 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8159a940-de22-4cc3-b309-6e46843ffeeb tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c7741c11-7d5d-4f13-bfc1-ab526258a9ed {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:56 devstack sudo[92059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c7741c11-7d5d-4f13-bfc1-ab526258a9ed
Feb 28 04:50:56 devstack sudo[92059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:57 devstack sudo[92059]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:57 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8159a940-de22-4cc3-b309-6e46843ffeeb tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-c7741c11-7d5d-4f13-bfc1-ab526258a9ed" returned: 0 in 0.409s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:57 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8159a940-de22-4cc3-b309-6e46843ffeeb tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "cinder-quobyte-c7741c11-7d5d-4f13-bfc1-ab526258a9ed" released by "delete_volume" :: held 0.898s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:57 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-8159a940-de22-4cc3-b309-6e46843ffeeb tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Created reservations ['8ab16857-64b0-493a-b2fc-0fcb69b42d3f', '9f2411fa-8f24-413a-91a3-c6bbeaa8baa3', '9d4105ac-ccf6-4d66-81aa-03faedb131e3', 'fbe1224e-18dc-440f-86f0-d65a864606dc'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:50:57 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-8159a940-de22-4cc3-b309-6e46843ffeeb tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:57 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-8159a940-de22-4cc3-b309-6e46843ffeeb tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:57 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-8159a940-de22-4cc3-b309-6e46843ffeeb tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:57 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-8159a940-de22-4cc3-b309-6e46843ffeeb tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:57 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-8159a940-de22-4cc3-b309-6e46843ffeeb tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:57 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8159a940-de22-4cc3-b309-6e46843ffeeb tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:57 devstack sudo[92062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:50:57 devstack sudo[92062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:57 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-5a8c5ca1-3375-4754-b428-fe2623dbe547 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Acquiring lock "cinder-e92b3def-3424-458b-9869-af92a14456c1-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:57 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-5a8c5ca1-3375-4754-b428-fe2623dbe547 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "cinder-e92b3def-3424-458b-9869-af92a14456c1-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:57 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-5a8c5ca1-3375-4754-b428-fe2623dbe547 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Acquiring lock "cinder-quobyte-e92b3def-3424-458b-9869-af92a14456c1" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:57 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-5a8c5ca1-3375-4754-b428-fe2623dbe547 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "cinder-quobyte-e92b3def-3424-458b-9869-af92a14456c1" acquired by "delete_volume" :: waited 0.011s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:57 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c46f8c0-e5f2-49ec-a285-3974fc0cb950]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:57 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5a8c5ca1-3375-4754-b428-fe2623dbe547 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e92b3def-3424-458b-9869-af92a14456c1 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:57 devstack sudo[92064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e92b3def-3424-458b-9869-af92a14456c1
Feb 28 04:50:57 devstack sudo[92064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:57 devstack sudo[92062]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:57 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-8159a940-de22-4cc3-b309-6e46843ffeeb tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.412s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:57 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-8159a940-de22-4cc3-b309-6e46843ffeeb tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:50:57 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-8159a940-de22-4cc3-b309-6e46843ffeeb tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Deleted volume successfully.
Feb 28 04:50:57 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-8159a940-de22-4cc3-b309-6e46843ffeeb tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "cinder-c7741c11-7d5d-4f13-bfc1-ab526258a9ed-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:57 devstack sudo[92064]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:57 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5a8c5ca1-3375-4754-b428-fe2623dbe547 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e92b3def-3424-458b-9869-af92a14456c1" returned: 0 in 0.475s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:57 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5a8c5ca1-3375-4754-b428-fe2623dbe547 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e92b3def-3424-458b-9869-af92a14456c1 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:57 devstack sudo[92070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e92b3def-3424-458b-9869-af92a14456c1
Feb 28 04:50:57 devstack sudo[92070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:58 devstack sudo[92070]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:58 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5a8c5ca1-3375-4754-b428-fe2623dbe547 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-e92b3def-3424-458b-9869-af92a14456c1" returned: 0 in 0.399s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:58 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-5a8c5ca1-3375-4754-b428-fe2623dbe547 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "cinder-quobyte-e92b3def-3424-458b-9869-af92a14456c1" released by "delete_volume" :: held 0.897s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:58 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-5a8c5ca1-3375-4754-b428-fe2623dbe547 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Created reservations ['518f15ae-a7b7-4cda-97ec-2f68364db25f', '1a310312-5676-4e4e-81b7-63d6a1f470bd', '6e6f6695-b20c-4e1d-9c5e-ce41d5b7e2b8', '2135fb9d-8927-4d62-8801-f97161efe29c'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:50:58 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5a8c5ca1-3375-4754-b428-fe2623dbe547 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:58 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5a8c5ca1-3375-4754-b428-fe2623dbe547 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:58 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-5a8c5ca1-3375-4754-b428-fe2623dbe547 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:58 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-5a8c5ca1-3375-4754-b428-fe2623dbe547 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:58 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-5a8c5ca1-3375-4754-b428-fe2623dbe547 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:58 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5a8c5ca1-3375-4754-b428-fe2623dbe547 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:58 devstack sudo[92073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:50:58 devstack sudo[92073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:58 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-58f6812f-1cf8-48ee-a264-67486aaf68eb tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Acquiring lock "cinder-fe49dc4a-f05a-46ea-8cdf-277eb79c094f-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:58 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-58f6812f-1cf8-48ee-a264-67486aaf68eb tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "cinder-fe49dc4a-f05a-46ea-8cdf-277eb79c094f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:58 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-58f6812f-1cf8-48ee-a264-67486aaf68eb tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Acquiring lock "cinder-quobyte-fe49dc4a-f05a-46ea-8cdf-277eb79c094f" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:58 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-58f6812f-1cf8-48ee-a264-67486aaf68eb tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "cinder-quobyte-fe49dc4a-f05a-46ea-8cdf-277eb79c094f" acquired by "delete_volume" :: waited 0.019s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:58 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d24dc41-4407-4cf3-a502-ed6a78563d66]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:58 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-58f6812f-1cf8-48ee-a264-67486aaf68eb tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-fe49dc4a-f05a-46ea-8cdf-277eb79c094f {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:58 devstack sudo[92075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-fe49dc4a-f05a-46ea-8cdf-277eb79c094f
Feb 28 04:50:58 devstack sudo[92075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:58 devstack sudo[92073]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:58 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-5a8c5ca1-3375-4754-b428-fe2623dbe547 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.423s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:58 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-5a8c5ca1-3375-4754-b428-fe2623dbe547 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:50:58 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-5a8c5ca1-3375-4754-b428-fe2623dbe547 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Deleted volume successfully.
Feb 28 04:50:58 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-5a8c5ca1-3375-4754-b428-fe2623dbe547 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "cinder-e92b3def-3424-458b-9869-af92a14456c1-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:58 devstack sudo[92075]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:58 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-58f6812f-1cf8-48ee-a264-67486aaf68eb tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-fe49dc4a-f05a-46ea-8cdf-277eb79c094f" returned: 0 in 0.467s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:58 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-58f6812f-1cf8-48ee-a264-67486aaf68eb tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-fe49dc4a-f05a-46ea-8cdf-277eb79c094f {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:58 devstack sudo[92081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-fe49dc4a-f05a-46ea-8cdf-277eb79c094f
Feb 28 04:50:58 devstack sudo[92081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:59 devstack sudo[92081]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-58f6812f-1cf8-48ee-a264-67486aaf68eb tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-fe49dc4a-f05a-46ea-8cdf-277eb79c094f" returned: 0 in 0.414s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:59 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-58f6812f-1cf8-48ee-a264-67486aaf68eb tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "cinder-quobyte-fe49dc4a-f05a-46ea-8cdf-277eb79c094f" released by "delete_volume" :: held 0.904s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:50:59 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-58f6812f-1cf8-48ee-a264-67486aaf68eb tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Created reservations ['6d0730e9-d5e5-452f-b6e0-359861bc6d62', '8fda4690-b046-45de-8abc-e7f035b2db17', 'e05bc1d5-0f86-463c-a1b8-7682775703c1', '9add2a0d-dbd4-4f81-b684-87acea0c4fdc'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:50:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-58f6812f-1cf8-48ee-a264-67486aaf68eb tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:50:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-58f6812f-1cf8-48ee-a264-67486aaf68eb tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:50:59 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-58f6812f-1cf8-48ee-a264-67486aaf68eb tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:50:59 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-58f6812f-1cf8-48ee-a264-67486aaf68eb tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:50:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-58f6812f-1cf8-48ee-a264-67486aaf68eb tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:50:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-58f6812f-1cf8-48ee-a264-67486aaf68eb tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:59 devstack sudo[92084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:50:59 devstack sudo[92084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:59 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-72bcbb10-c93a-49cc-943a-46155888fe22 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Acquiring lock "cinder-df04dcbb-0e9c-4c55-ae52-2fcc74b7bace-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:59 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-72bcbb10-c93a-49cc-943a-46155888fe22 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "cinder-df04dcbb-0e9c-4c55-ae52-2fcc74b7bace-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:59 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-72bcbb10-c93a-49cc-943a-46155888fe22 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Acquiring lock "cinder-quobyte-df04dcbb-0e9c-4c55-ae52-2fcc74b7bace" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:50:59 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-72bcbb10-c93a-49cc-943a-46155888fe22 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "cinder-quobyte-df04dcbb-0e9c-4c55-ae52-2fcc74b7bace" acquired by "delete_volume" :: waited 0.013s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:50:59 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[211ad700-c0e9-4153-8688-9c3df1dd7f5e]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:50:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-72bcbb10-c93a-49cc-943a-46155888fe22 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-df04dcbb-0e9c-4c55-ae52-2fcc74b7bace {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:50:59 devstack sudo[92086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-df04dcbb-0e9c-4c55-ae52-2fcc74b7bace
Feb 28 04:50:59 devstack sudo[92086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:50:59 devstack sudo[92084]: pam_unix(sudo:session): session closed for user root
Feb 28 04:50:59 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-58f6812f-1cf8-48ee-a264-67486aaf68eb tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.425s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:50:59 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-58f6812f-1cf8-48ee-a264-67486aaf68eb tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:50:59 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-58f6812f-1cf8-48ee-a264-67486aaf68eb tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Deleted volume successfully.
Feb 28 04:50:59 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-58f6812f-1cf8-48ee-a264-67486aaf68eb tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "cinder-fe49dc4a-f05a-46ea-8cdf-277eb79c094f-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:51:00 devstack sudo[92086]: pam_unix(sudo:session): session closed for user root
Feb 28 04:51:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-72bcbb10-c93a-49cc-943a-46155888fe22 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-df04dcbb-0e9c-4c55-ae52-2fcc74b7bace" returned: 0 in 0.465s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:51:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-72bcbb10-c93a-49cc-943a-46155888fe22 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-df04dcbb-0e9c-4c55-ae52-2fcc74b7bace {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:51:00 devstack sudo[92093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-df04dcbb-0e9c-4c55-ae52-2fcc74b7bace
Feb 28 04:51:00 devstack sudo[92093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:51:00 devstack sudo[92093]: pam_unix(sudo:session): session closed for user root
Feb 28 04:51:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-72bcbb10-c93a-49cc-943a-46155888fe22 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-df04dcbb-0e9c-4c55-ae52-2fcc74b7bace" returned: 0 in 0.393s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:51:00 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-72bcbb10-c93a-49cc-943a-46155888fe22 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "cinder-quobyte-df04dcbb-0e9c-4c55-ae52-2fcc74b7bace" released by "delete_volume" :: held 0.881s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:51:00 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-72bcbb10-c93a-49cc-943a-46155888fe22 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Created reservations ['bdc38df8-6710-4e40-8d62-e77ec0ae2146', '76511985-dd31-46c3-b075-da7d9038a132', '347ae425-6d12-4984-8439-1726f24d5bea', '5892d48e-7835-476c-b14c-b93ab3676d89'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:51:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-72bcbb10-c93a-49cc-943a-46155888fe22 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:51:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-72bcbb10-c93a-49cc-943a-46155888fe22 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:51:00 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-72bcbb10-c93a-49cc-943a-46155888fe22 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:51:00 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-72bcbb10-c93a-49cc-943a-46155888fe22 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:51:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-72bcbb10-c93a-49cc-943a-46155888fe22 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:51:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-72bcbb10-c93a-49cc-943a-46155888fe22 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:51:00 devstack sudo[92096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:51:00 devstack sudo[92096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:51:00 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-03403c06-c42b-44d3-ae48-1eeb9ff72880 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Acquiring lock "cinder-4de51be4-5ab8-4a0c-bbc2-c0da8954c435-delete_volume" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:51:00 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-03403c06-c42b-44d3-ae48-1eeb9ff72880 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "cinder-4de51be4-5ab8-4a0c-bbc2-c0da8954c435-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:51:00 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-03403c06-c42b-44d3-ae48-1eeb9ff72880 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Acquiring lock "cinder-quobyte-4de51be4-5ab8-4a0c-bbc2-c0da8954c435" by "delete_volume" {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 04:51:00 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-03403c06-c42b-44d3-ae48-1eeb9ff72880 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "cinder-quobyte-4de51be4-5ab8-4a0c-bbc2-c0da8954c435" acquired by "delete_volume" :: waited 0.009s {{(pid=84248) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 04:51:00 devstack cinder-volume[84248]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fdaec78-4af3-4a88-853a-782c38db616f]: (4, 'qcow2') {{(pid=85115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 04:51:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-03403c06-c42b-44d3-ae48-1eeb9ff72880 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4de51be4-5ab8-4a0c-bbc2-c0da8954c435 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:51:00 devstack sudo[92098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4de51be4-5ab8-4a0c-bbc2-c0da8954c435
Feb 28 04:51:00 devstack sudo[92098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:51:00 devstack sudo[92096]: pam_unix(sudo:session): session closed for user root
Feb 28 04:51:00 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-72bcbb10-c93a-49cc-943a-46155888fe22 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.442s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:51:00 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-72bcbb10-c93a-49cc-943a-46155888fe22 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:51:00 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-72bcbb10-c93a-49cc-943a-46155888fe22 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Deleted volume successfully.
Feb 28 04:51:00 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-72bcbb10-c93a-49cc-943a-46155888fe22 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "cinder-df04dcbb-0e9c-4c55-ae52-2fcc74b7bace-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:51:01 devstack sudo[92098]: pam_unix(sudo:session): session closed for user root
Feb 28 04:51:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-03403c06-c42b-44d3-ae48-1eeb9ff72880 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4de51be4-5ab8-4a0c-bbc2-c0da8954c435" returned: 0 in 0.466s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:51:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-03403c06-c42b-44d3-ae48-1eeb9ff72880 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4de51be4-5ab8-4a0c-bbc2-c0da8954c435 {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:51:01 devstack sudo[92104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4de51be4-5ab8-4a0c-bbc2-c0da8954c435
Feb 28 04:51:01 devstack sudo[92104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:51:01 devstack sudo[92104]: pam_unix(sudo:session): session closed for user root
Feb 28 04:51:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-03403c06-c42b-44d3-ae48-1eeb9ff72880 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc/volume-4de51be4-5ab8-4a0c-bbc2-c0da8954c435" returned: 0 in 0.409s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:51:01 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-03403c06-c42b-44d3-ae48-1eeb9ff72880 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "cinder-quobyte-4de51be4-5ab8-4a0c-bbc2-c0da8954c435" released by "delete_volume" :: held 0.896s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:51:01 devstack cinder-volume[84248]: DEBUG dbcounter [-] [84248] Writing DB stats cinder:SELECT=219,cinder:UPDATE=306,cinder:INSERT=66,cinder:DELETE=29 {{(pid=84248) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 04:51:01 devstack cinder-volume[84248]: DEBUG dbcounter [-] [84248] Writing DB stats cinder:UPDATE=284,cinder:SELECT=205,cinder:DELETE=24,cinder:INSERT=75 {{(pid=84248) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 04:51:01 devstack cinder-volume[84248]: DEBUG cinder.quota [None req-03403c06-c42b-44d3-ae48-1eeb9ff72880 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Created reservations ['a4d9d9ab-8f9d-4c75-a003-526d630d4abb', '6948703d-a356-478f-be58-5e44de2fa3b8', '1ed4ee86-001e-4043-837d-abfdea3951f7', 'cc77611e-64f5-439f-b435-1c308c92437d'] {{(pid=84248) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 04:51:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-03403c06-c42b-44d3-ae48-1eeb9ff72880 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 04:51:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-03403c06-c42b-44d3-ae48-1eeb9ff72880 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 04:51:01 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-03403c06-c42b-44d3-ae48-1eeb9ff72880 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035': None} {{(pid=84248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 04:51:01 devstack cinder-volume[84248]: DEBUG cinder.volume.drivers.quobyte [None req-03403c06-c42b-44d3-ae48-1eeb9ff72880 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-384918f6-57d3-4c2d-bd55-31f15c9fa035'] {{(pid=84248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 04:51:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.lockutils [None req-03403c06-c42b-44d3-ae48-1eeb9ff72880 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84248) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 04:51:01 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-03403c06-c42b-44d3-ae48-1eeb9ff72880 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 04:51:01 devstack sudo[92107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc
Feb 28 04:51:01 devstack sudo[92107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 04:51:02 devstack sudo[92107]: pam_unix(sudo:session): session closed for user root
Feb 28 04:51:02 devstack cinder-volume[84248]: DEBUG oslo_concurrency.processutils [None req-03403c06-c42b-44d3-ae48-1eeb9ff72880 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/208e5ac7c61e38b724d88655bbd6c7cc" returned: 0 in 0.435s {{(pid=84248) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 04:51:02 devstack cinder-volume[84248]: DEBUG cinder.manager [None req-03403c06-c42b-44d3-ae48-1eeb9ff72880 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Notifying Schedulers of capabilities ... {{(pid=84248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 04:51:02 devstack cinder-volume[84248]: INFO cinder.volume.manager [None req-03403c06-c42b-44d3-ae48-1eeb9ff72880 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Deleted volume successfully.
Feb 28 04:51:02 devstack cinder-volume[84248]: DEBUG cinder.coordination [None req-03403c06-c42b-44d3-ae48-1eeb9ff72880 tempest-CreateVolumesFromSourceVolumeTest-1228549606 None] Lock "cinder-4de51be4-5ab8-4a0c-bbc2-c0da8954c435-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=84248) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 04:51:11 devstack cinder-volume[84248]: DEBUG dbcounter [-] [84248] Writing DB stats cinder:INSERT=1,cinder:UPDATE=9,cinder:SELECT=1 {{(pid=84248) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 04:51:12 devstack cinder-volume[84248]: DEBUG dbcounter [-] [84248] Writing DB stats cinder:SELECT=5,cinder:INSERT=3,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=84248) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}